00000001:02000400:3.0F:1789583502.289645:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789583520.318511:0:3183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1789583521.663567:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 907 MB/s 00000001:01000000:2.0F:1789583521.913278:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 735 MB/s 00000001:01000000:0.0F:1789583522.167193:0:3239:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3724 MB/s 00000020:02000000:0.0:1789583522.769088:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_g81e4dae 00000400:02000000:1.0F:1789583523.541007:0:3289:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.146@tcp [8/256/0/180] 00008000:02000000:3.0:1789583527.197294:0:3439:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789583576.872704:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789583585.715528:0:5829:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789583585.715537:0:5829:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789583585.715660:0:5829:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000575c1a03 00000080:02000400:0.0:1789583585.715674:0:5829:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789583585.721074:0:5829:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789583585.721093:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789583585.721225:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d6a07ccd) 00000020:00000080:2.0:1789583585.721250:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789583585.739956:0:5829:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789583585.740905:0:5829:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789583585.777801:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789583585.777876:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789583585.777899:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789583585.777957:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789583585.777990:0:5829:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789583585.779662:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789583585.779678:0:5829:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789583585.779710:0:5829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2afa 00000020:01000004:3.0:1789583585.779722:0:5829:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789583585.779728:0:5829:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789583585.779736:0:5829:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000575c1a03 from MGS 00000020:01000004:3.0:1789583585.779742:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789583585.779776:0:5829:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008e94f7a1) 00000020:00000080:3.0:1789583585.779794:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789583585.780712:0:5829:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000575c1a03 from MGS, refs=2 00080000:01000000:3.0:1789583585.780725:0:5829:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789583585.780734:0:5829:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2b08 00000100:00100000:3.0:1789583585.780917:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789583585.781073:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789583585.781081:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789583585.785762:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789583585.785780:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789583585.787101:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789583585.787467:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789583585.787474:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789583585.791132:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789583585.791153:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789583585.798092:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789583585.798112:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789583585.801681:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583585.801689:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583585.801691:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583585.802277:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583585.802281:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583585.802282:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583585.803930:0:5829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789583585.806492:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789583586.054057:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4247 MB/s 00000001:01000000:0.0:1789583586.303954:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5327 MB/s 00000001:01000000:3.0:1789583586.555010:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1043 MB/s 00000001:01000000:2.0:1789583586.805655:0:5829:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1051 MB/s 00080000:10000000:2.0:1789583586.813570:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789583586.825347:0:5829:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789583586.825363:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789583586.825365:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789583586.829677:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789583586.829792:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789583586.829935:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789583586.830152:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789583586.830178:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789583586.830487:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789583586.830665:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789583586.830672:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789583586.831520:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789583586.831535:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789583586.832137:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789583586.832144:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789583586.832970:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789583586.832990:0:5829:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.146@tcp' 00000020:01000004:1.0:1789583586.832992:0:5829:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789583586.833066:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.146@tcp (typ=mgc) 00000020:00000080:1.0:1789583586.833085:0:5829:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.146@tcp (00000000a09427c4) 00000020:00000080:1.0:1789583586.833103:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789583586.833226:0:5829:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a49fb4a8@MGC192.168.203.146@tcp: add connection 192.168.203.146@tcp at head 00000100:00080000:3.0:1789583586.833341:0:5844:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1789583586.833494:0:5829:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.146@tcp-0 is initialized 00000040:01000000:1.0:1789583586.833501:0:5829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789583586.841697:0:5845:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789583586.841750:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.146@tcp (uuid 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b) 00000020:00000080:1.0:1789583586.841772:0:5829:0:(genops.c:1384:class_connect()) connect: client 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b, cookie 0x6d3e73d72c6e2b16 00000100:00080000:1.0:1789583586.841784:0:5829:0:(import.c:545:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789583586.841794:0:5829:0:(import.c:666:import_select_connection()) MGC192.168.203.146@tcp: import 00000000a49fb4a8 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789583586.841867:0:5829:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000087abcc45 x1876514332213376/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789583586.841949:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3304:1876514332213376:0@lo:250: 00000100:00100000:1.0:1789583586.844255:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789583586.844457:0:5829:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS 00000020:01000004:1.0:1789583586.845395:0:5829:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789583586.845402:0:5829:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789583586.845416:0:5829:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000061b4f145) 00000020:00000080:1.0:1789583586.845431:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789583586.848790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332213376 00000100:00100000:0.0:1789583586.848835:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332213376 00000100:00100000:0.0:1789583586.848882:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583586.848889:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ed464f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876514332213376:12345-0@lo:250: 00010000:00080000:0.0:1789583586.852571:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b@0@lo t0 exp 0000000000000000 cur 143 last 0 00000020:00000080:0.0:1789583586.852604:0:5841:0:(genops.c:1384:class_connect()) connect: client 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b, cookie 0x6d3e73d72c6e2b24 00000100:00080000:0.0:1789583586.852756:0:5841:0:(import.c:65:import_set_state_nolock()) 00000000204ec7d0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583586.852880:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ed464f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:3304:x1876514332213376:12345-0@lo:250: Request processed in 3989us (8629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583586.852890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583586.855384:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789583586.855397:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.146@tcp: connect to target with instance 0 00000100:00080000:1.0:1789583586.855404:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789583586.855409:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789583586.855412:0:3304:0:(import.c:65:import_set_state_nolock()) 00000000a49fb4a8 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789583586.855416:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789583586.855423:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789583586.855430:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3304:1876514332213376:0@lo:250: 00010000:00010000:0.0:1789583586.856629:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583586.875243:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789583586.875437:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789583586.875443:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789583586.876514:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789583586.876523:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789583586.877328:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789583586.877337:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789583586.878581:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789583586.878786:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789583586.878792:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789583586.880733:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789583586.880747:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789583586.922254:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583586.922463:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789583586.922470:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789583586.923625:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789583586.923637:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789583586.924474:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583586.924639:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789583586.924644:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789583586.925130:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789583586.925212:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789583586.925954:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583586.926107:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789583586.926112:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789583586.926709:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789583586.926724:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789583586.927348:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583586.927527:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789583586.927533:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789583586.928289:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789583586.928298:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789583586.950314:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789583586.950548:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789583586.950563:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789583586.953375:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789583586.953393:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789583586.958497:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789583586.958514:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789583586.960092:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789583586.960119:0:5829:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789583586.960127:0:5829:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789583586.960414:0:5829:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789583586.960447:0:5829:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789583586.960451:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789583586.960453:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583586.960455:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583586.960456:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583586.960458:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583586.960459:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583586.960460:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583586.960461:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583586.960463:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789583586.960464:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789583586.960465:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583586.960466:0:5829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583586.960469:0:5829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789583586.960471:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789583586.960472:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583586.960473:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583586.960474:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583586.960475:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583586.960480:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583586.960481:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583586.960481:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583586.960482:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789583586.960483:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789583586.960484:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583586.960485:0:5829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583586.960515:0:5829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789583586.960531:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007b12288 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213504:0@lo:253: 00000100:00100000:0.0:1789583586.960594:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583586.960773:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f569962 going to sleep for 11 seconds 00000100:00100000:3.0:1789583586.960990:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332213504 00000100:00100000:3.0:1789583586.960998:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332213504 00000100:00100000:3.0:1789583586.961836:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583586.961855:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f3fe4258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:5829:x1876514332213504:12345-0@lo:253: 20000000:01000000:3.0:1789583586.961906:0:5843:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789583586.961909:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789583586.963372:0:5864:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789583586.963438:0:5843:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1789583586.963724:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789583586.966702:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789583586.967105:0:5843:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789583586.967110:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789583586.967116:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789583586.967119:0:5843:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789583586.967135:0:5843:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789583586.967721:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789583586.968275:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789583586.968291:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789583586.968335:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789583586.968396:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789583586.968434:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789583586.968535:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789583586.968542:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789583586.968586:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789583586.968594:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789583586.969963:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789583586.969983:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789583586.970037:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789583586.970587:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789583586.970726:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789583586.970738:0:5843:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789583586.970753:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583586.971370:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789583586.971385:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789583586.971424:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789583586.971453:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789583586.971492:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789583586.971503:0:5843:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789583586.971570:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789583586.971578:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789583586.972332:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789583586.972390:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789583586.972426:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789583586.972439:0:5843:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789583586.972542:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789583586.972552:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789583586.972582:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789583586.972707:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789583586.973022:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789583586.973074:0:5843:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789583586.973090:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789583586.973708:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789583586.974277:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789583586.974304:0:5843:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.146@tcp for mdt 20000000:01000000:3.0:1789583586.974306:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789583586.974345:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789583586.974353:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789583586.974382:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789583586.974389:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789583586.974433:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789583586.974443:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789583586.974472:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789583586.974505:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789583586.974567:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789583586.974571:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789583586.974575:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789583586.974586:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789583586.974588:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789583586.974707:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789583586.974709:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789583586.975384:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789583586.975715:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789583586.975760:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789583586.975893:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1789583586.975906:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789583586.975909:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789583586.976303:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789583586.976509:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789583586.976542:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789583586.976569:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789583586.976581:0:5843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789583586.976583:0:5843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789583586.976587:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789583586.976589:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789583586.976667:0:5843:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789583586.976673:0:5843:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789583586.977480:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789583586.977675:0:5843:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789583586.996278:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789583586.996330:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789583586.996410:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789583586.996432:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789583586.996452:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996468:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996478:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996483:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996488:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996494:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996499:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000631737d4 already unused, calling callback (000000000ff25d57) 00010000:00010000:0.0:1789583586.996509:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996517:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996528:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996535:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583586.996540:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000631737d4/0x6d3e73d72c6e2b2b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789583586.996556:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789583587.210652:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f3fe4258 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:5829:x1876514332213504:12345-0@lo:253: Request processed in 248792us (250052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583587.210667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583587.210784:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007b12288 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213504:0@lo:253: 10000000:01000000:0.0:1789583587.210799:0:5829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789583587.210802:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789583587.210834:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583587.210835:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583587.210836:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789583587.210837:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583587.210839:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583587.210840:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583587.210841:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583587.210842:0:5829:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789583587.210843:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583587.210844:0:5829:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789583587.210862:0:5829:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000575c1a03 from lustre-MDT0000 10000000:01000000:0.0:1789583587.210886:0:5829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789583587.210888:0:5829:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789583587.210892:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88b648de8000 10000000:01000000:0.0:1789583587.210896:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789583587.210909:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b648de8000 from 1 10000000:01000000:0.0:1789583587.210912:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789583587.210946:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.210955:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.210964:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583587.210981:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007b12288 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213632:0@lo:101: 00000100:00100000:0.0:1789583587.211015:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583587.211054:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba37255b going to sleep for 11 seconds 00000100:00100000:3.0:1789583587.211278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332213632 00000100:00100000:3.0:1789583587.211285:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332213632 00000100:00100000:3.0:1789583587.211323:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583587.211331:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000879087f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:5829:x1876514332213632:12345-0@lo:101: 00010000:00010000:3.0:1789583587.211343:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583587.211356:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009268b07a/0x6d3e73d72c6e2b39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2b32 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.211375:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009268b07a/0x6d3e73d72c6e2b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.211384:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009268b07a/0x6d3e73d72c6e2b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.211391:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009268b07a, rc 0) 00000100:00100000:3.0:1789583587.211429:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000879087f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+6:5829:x1876514332213632:12345-0@lo:101: Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583587.211435:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583587.211516:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007b12288 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213632:0@lo:101: 00010000:00010000:0.0:1789583587.211527:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.211535:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583587.211575:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007b12288 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213760:0@lo:501: 00000100:00100000:0.0:1789583587.211597:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583587.211617:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ba37255b going to sleep for 11 seconds 00000100:00100000:3.0:1789583587.211714:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332213760 00000100:00100000:3.0:1789583587.211719:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332213760 00000100:00100000:3.0:1789583587.211746:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583587.211751:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042ecbe02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+6:5829:x1876514332213760:12345-0@lo:501: 00000100:00100000:3.0:1789583587.211980:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042ecbe02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+6:5829:x1876514332213760:12345-0@lo:501: Request processed in 229us (382us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789583587.211988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789583587.212058:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007b12288 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213760:0@lo:501: 10000000:01000000:2.0:1789583587.212090:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789583587.212217:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212226:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000631737d4/0x6d3e73d72c6e2b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583587.212234:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b666645000 10000000:01000000:2.0:1789583587.212238:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789583587.212242:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88b666645000 10000000:01000000:2.0:1789583587.212244:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789583587.212247:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88b666645000 from 1 10000000:01000000:2.0:1789583587.212249:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789583587.212277:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212285:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212292:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.212304:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213888:0@lo:101: 00000100:00100000:2.0:1789583587.212337:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.212358:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dc78094 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.212454:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332213888 00000100:00100000:0.0:1789583587.212459:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332213888 00000100:00100000:0.0:1789583587.212489:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583587.212494:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a9b68ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+6:5829:x1876514332213888:12345-0@lo:101: 00010000:00010000:0.0:1789583587.212502:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583587.212517:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e87899f/0x6d3e73d72c6e2b47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2b40 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.212532:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e87899f/0x6d3e73d72c6e2b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b40 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.212539:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e87899f/0x6d3e73d72c6e2b47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b40 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.212546:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e87899f, rc 0) 00000100:00100000:0.0:1789583587.212577:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a9b68ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+7:5829:x1876514332213888:12345-0@lo:101: Request processed in 83us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.212583:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789583587.212714:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332213888:0@lo:101: 00010000:00010000:2.0:1789583587.212723:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212730:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583587.212741:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789583587.212755:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212762:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000331a01b4/0x6d3e73d72c6e2b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583587.212767:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789583587.212770:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789583587.212774:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88b666645000 10000000:01000000:2.0:1789583587.212776:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789583587.212779:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789583587.212781:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789583587.212793:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212799:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.212826:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.212844:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214016:0@lo:101: 00000100:00100000:2.0:1789583587.212868:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.212887:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dc78094 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.212944:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214016 00000100:00100000:0.0:1789583587.212948:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214016 00000100:00100000:0.0:1789583587.212977:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789583587.212982:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000bef838f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+7:5829:x1876514332214016:12345-0@lo:101: 00010000:00010000:0.0:1789583587.212988:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583587.212994:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004a21e4eb/0x6d3e73d72c6e2b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2b4e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.213007:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004a21e4eb/0x6d3e73d72c6e2b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.213014:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004a21e4eb/0x6d3e73d72c6e2b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583587.213020:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004a21e4eb, rc 0) 00000100:00100000:0.0:1789583587.213044:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000bef838f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+8:5829:x1876514332214016:12345-0@lo:101: Request processed in 63us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.213059:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789583587.213381:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214016:0@lo:101: 00010000:00010000:2.0:1789583587.213391:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.213516:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.213556:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214144:0@lo:501: 00000100:00100000:2.0:1789583587.213582:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.213601:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dc78094 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.213651:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214144 00000100:00100000:0.0:1789583587.213655:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214144 00000100:00100000:0.0:1789583587.213691:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789583587.213697:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d1f91f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+8:5829:x1876514332214144:12345-0@lo:501: 00000100:00100000:0.0:1789583587.214032:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d1f91f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5829:x1876514332214144:12345-0@lo:501: Request processed in 335us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.214040:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789583587.214692:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214144:0@lo:501: 00000100:00100000:2.0:1789583587.214734:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214272:0@lo:503: 00000100:00100000:2.0:1789583587.214781:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.214835:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000dc78094 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.214890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214272 00000100:00100000:0.0:1789583587.214896:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214272 00000100:00100000:0.0:1789583587.214931:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789583587.214938:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000048e29f49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5829:x1876514332214272:12345-0@lo:503: 00000100:00100000:0.0:1789583587.215079:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000048e29f49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5829:x1876514332214272:12345-0@lo:503: Request processed in 141us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.215086:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583587.215524:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214272:0@lo:503: 00000100:00100000:2.0:1789583587.216244:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5872:1876514332214400:0@lo:502: 00000100:00100000:2.0:1789583587.216301:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.216332:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6babe13 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.216474:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214400 00000100:00100000:0.0:1789583587.216481:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214400 00000100:00100000:0.0:1789583587.216517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789583587.216524:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cb8b0c2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5872:x1876514332214400:12345-0@lo:502: 00000100:00100000:0.0:1789583587.216703:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cb8b0c2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5872:x1876514332214400:12345-0@lo:502: Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.216709:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789583587.216879:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5872:1876514332214400:0@lo:502: 00000020:01000000:2.0:1789583587.216902:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583587.216913:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.216921:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789583587.216926:0:5872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789583587.216929:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789583587.216941:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005187a806) 00000020:00000080:2.0:1789583587.216955:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789583587.216960:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789583587.217073:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789583587.217081:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2b63 00000020:00000080:2.0:1789583587.217548:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789583587.217553:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583587.217557:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.217558:0:5872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789583587.217561:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583587.217565:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.217566:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789583587.217569:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789583587.217577:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bc75237f) 00000020:00000080:2.0:1789583587.217586:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789583587.217589:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789583587.217591:0:5872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789583587.217593:0:5872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789583587.217599:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789583587.217641:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000575c1a03 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789583587.217652:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a427262e) 00000020:00000080:2.0:1789583587.217658:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789583587.217723:0:5872:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789583587.217728:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e2b78 00000020:00000080:2.0:1789583587.217852:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789583587.217858:0:5872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789583587.217863:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6d3e73d72c6e2b7f 00080000:01000000:2.0:1789583587.217867:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789583587.217871:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2b86 00080000:10000000:2.0:1789583587.220079:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789583587.220438:0:5872:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789583587.227616:0:5872:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789583587.320800:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789583587.321436:0:5872:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789583587.330144:0:5872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789583587.330421:0:5872:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789583587.374951:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a064a1c0) 00000020:00000080:2.0:1789583587.374972:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789583587.377424:0:5872:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789583587.377439:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2b94 00000020:00000080:2.0:1789583587.379395:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789583587.386239:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583587.449579:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583587.531622:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583587.565604:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583587.605231:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789583587.652866:0:5872:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789583587.684173:0:5872:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6d3e73d72c6e2b9b 00000020:00000080:2.0:1789583587.684762:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789583587.684774:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583587.684780:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.684783:0:5872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789583587.684786:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583587.684790:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.684791:0:5872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789583587.684794:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789583587.684795:0:5872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789583587.684798:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583587.684800:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.684801:0:5872:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789583587.684803:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583587.684825:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583587.684826:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789583587.684830:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789583587.684867:0:5872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789583587.685049:0:5872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5872:1876514332214528:0@lo:502: 00000100:00100000:2.0:1789583587.685123:0:5872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.685221:0:5872:0:(client.c:2716:ptlrpc_set_wait()) set 00000000985ddbe1 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.685519:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214528 00000100:00100000:0.0:1789583587.685526:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214528 00000100:00100000:0.0:1789583587.685610:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789583587.685619:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000323df617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5872:x1876514332214528:12345-0@lo:502: 00000100:00100000:0.0:1789583587.686122:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000323df617 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5872:x1876514332214528:12345-0@lo:502: Request processed in 503us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.686131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789583587.686219:0:5872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c039ecd6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5872:1876514332214528:0@lo:502: 00000020:01000000:3.0:1789583587.686249:0:5872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583587.686255:0:5872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583587.686257:0:5872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789583587.686261:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789583587.686597:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789583587.686616:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789583587.686636:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.686647:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 000000001497d179/0x6d3e73d72c6e2b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583587.686654:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b666645000 from 1 10000000:01000000:1.0:1789583587.686656:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789583587.686694:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.686702:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.686710:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583587.686725:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214656:0@lo:101: 00000100:00100000:1.0:1789583587.686761:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583587.687257:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ba938c8 going to sleep for 11 seconds 00000100:00100000:2.0:1789583587.687435:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214656 00000100:00100000:2.0:1789583587.687442:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214656 00000100:00100000:3.0:1789583587.687591:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789583587.687600:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c65bdc18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:5829:x1876514332214656:12345-0@lo:101: 00010000:00010000:3.0:1789583587.687611:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583587.687624:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2ba2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.687647:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.687656:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.687663:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fd92a821, rc 0) 00000100:00100000:3.0:1789583587.687717:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c65bdc18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:5829:x1876514332214656:12345-0@lo:101: Request processed in 119us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583587.687738:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583587.687831:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214656:0@lo:101: 00010000:00010000:1.0:1789583587.687844:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.687853:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583587.688840:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214784:0@lo:256: 00000100:00100000:1.0:1789583587.688903:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583587.689273:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ba938c8 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.689502:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214784 00000100:00100000:0.0:1789583587.689510:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214784 00000100:00100000:0.0:1789583587.689545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789583587.689552:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bed2084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:5829:x1876514332214784:12345-0@lo:256: 20000000:01000000:0.0:1789583587.689568:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789583587.689574:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789583587.689650:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bed2084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:5829:x1876514332214784:12345-0@lo:256: Request processed in 99us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.689657:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583587.689747:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214784:0@lo:256: 10000000:01000000:1.0:1789583587.692860:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789583587.692894:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.692908:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583587.692917:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666645000 from 1 10000000:01000000:1.0:1789583587.692920:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789583587.693081:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.693089:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.693098:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583587.693118:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214912:0@lo:101: 00000100:00100000:1.0:1789583587.693180:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583587.693553:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332214912 00000100:00100000:3.0:1789583587.693562:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332214912 00000100:00100000:3.0:1789583587.693606:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789583587.693613:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000398363b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:5829:x1876514332214912:12345-0@lo:101: 00010000:00010000:3.0:1789583587.693624:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583587.693636:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2bb0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.693656:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.693664:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583587.693672:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b52c7331, rc 0) 00000100:00100000:3.0:1789583587.693716:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000398363b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332214912:12345-0@lo:101: Request processed in 104us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583587.693721:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789583587.694236:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ba938c8 going to sleep for 11 seconds 00000100:00100000:1.0:1789583587.694259:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332214912:0@lo:101: 00010000:00010000:1.0:1789583587.694377:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.694386:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583587.694456:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215040:0@lo:501: 00000100:00100000:1.0:1789583587.694485:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583587.694515:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ba938c8 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.694579:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215040 00000100:00100000:0.0:1789583587.694585:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215040 00000100:00100000:0.0:1789583587.694620:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789583587.694627:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005b5765f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332215040:12345-0@lo:501: 00000100:00100000:0.0:1789583587.696208:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005b5765f6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332215040:12345-0@lo:501: Request processed in 1578us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.696220:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789583587.696507:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215040:0@lo:501: 00000100:00100000:1.0:1789583587.696549:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215168:0@lo:503: 00000100:00100000:1.0:1789583587.696594:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583587.698497:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000007ba938c8 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.700344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215168 00000100:00100000:0.0:1789583587.700358:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215168 00000100:00100000:0.0:1789583587.700412:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789583587.700421:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000056d59101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332215168:12345-0@lo:503: 00000040:00080000:0.0:1789583587.700489:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789583587.700566:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000056d59101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332215168:12345-0@lo:503: Request processed in 146us (3971us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.700573:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583587.701100:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215168:0@lo:503: 00000040:00080000:1.0:1789583587.704197:0:5876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789583587.705186:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789583587.705208:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789583587.705226:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.705238:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583587.705347:0:5829:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789583587.705350:0:5829:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b666645000 10000000:01000000:2.0:1789583587.705352:0:5829:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b666645000 10000000:01000000:2.0:1789583587.705355:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789583587.705360:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b666645000 from 1 10000000:01000000:2.0:1789583587.705363:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789583587.705396:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.705404:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.705413:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.705436:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ee93507 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215296:0@lo:101: 00000100:00100000:2.0:1789583587.705496:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.705539:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000985ddbe1 going to sleep for 11 seconds 00000100:00100000:1.0:1789583587.705599:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215296 00000100:00100000:1.0:1789583587.705606:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215296 00000100:00100000:1.0:1789583587.705643:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583587.705651:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000587155ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332215296:12345-0@lo:101: 00010000:00010000:1.0:1789583587.705665:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583587.705687:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d0c9e245/0x6d3e73d72c6e2bc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2bbe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.705708:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d0c9e245/0x6d3e73d72c6e2bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.705718:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d0c9e245/0x6d3e73d72c6e2bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.705726:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d0c9e245, rc 0) 00000100:00100000:1.0:1789583587.705765:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000587155ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5829:x1876514332215296:12345-0@lo:101: Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583587.705789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789583587.706126:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ee93507 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215296:0@lo:101: 00010000:00010000:2.0:1789583587.706141:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.706158:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.706205:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ee93507 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215424:0@lo:501: 00000100:00100000:2.0:1789583587.706231:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.706259:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000985ddbe1 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.706367:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215424 00000100:00100000:0.0:1789583587.706372:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215424 00000100:00100000:0.0:1789583587.706406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583587.706412:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f00d1676 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5829:x1876514332215424:12345-0@lo:501: 00000100:00100000:0.0:1789583587.706650:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f00d1676 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5829:x1876514332215424:12345-0@lo:501: Request processed in 237us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.706657:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583587.706701:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ee93507 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215424:0@lo:501: 00000100:00100000:0.0:1789583587.706727:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed3317b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215552:0@lo:503: 00000100:00100000:0.0:1789583587.706762:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583587.706775:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6385e84 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.706788:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215552 00000100:00100000:0.0:1789583587.706792:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215552 00000100:00100000:0.0:1789583587.706834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789583587.706840:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b29a866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5829:x1876514332215552:12345-0@lo:503: 00000100:00100000:0.0:1789583587.707544:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b29a866 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5829:x1876514332215552:12345-0@lo:503: Request processed in 703us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.707552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789583587.707638:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed3317b5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332215552:0@lo:503: 00000100:00100000:1.0:1789583587.708247:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5877:1876514332215680:0@lo:502: 00000100:00100000:1.0:1789583587.708483:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583587.708551:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c11d4c52 going to sleep for 11 seconds 00000100:00100000:3.0:1789583587.708585:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215680 00000100:00100000:3.0:1789583587.708592:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215680 00000100:00100000:3.0:1789583587.708655:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789583587.708663:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae88bdc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5877:x1876514332215680:12345-0@lo:502: 00000100:00100000:3.0:1789583587.709074:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae88bdc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5877:x1876514332215680:12345-0@lo:502: Request processed in 412us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583587.709081:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789583587.709162:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087abcc45 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5877:1876514332215680:0@lo:502: 00000020:01000004:2.0:1789583587.709215:0:5877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789583587.709230:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000227a77da) 00000020:00000080:2.0:1789583587.709245:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789583587.709485:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000575c1a03 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789583587.709490:0:5877:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000575c1a03 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789583587.709492:0:5877:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000575c1a03 4 00010000:00080000:2.0:1789583587.709518:0:5877:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008f48957e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789583587.711768:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789583587.712458:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789583587.712502:0:5877:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789583587.712514:0:5877:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6d3e73d72c6e2bd3 00000100:00080000:2.0:1789583587.712524:0:5877:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789583587.712534:0:5877:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008f48957e using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583587.712567:0:5877:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002055b8c9 x1876514332215808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789583587.712599:0:5877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789583587.712772:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002055b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332215808:0@lo:38: 00000100:00100000:0.0:1789583587.712856:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.713188:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215808 00000100:00100000:2.0:1789583587.713202:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215808 00000100:00100000:2.0:1789583587.713242:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583587.713248:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007916db3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876514332215808:12345-0@lo:38: 00000100:00100000:2.0:1789583587.716159:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007916db3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876514332215808:12345-0@lo:38: Request processed in 2904us (3297us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789583587.716174:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583587.716311:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000743fbd1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5877:1876514332215936:0@lo:502: 00000100:00100000:2.0:1789583587.716363:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.716398:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 00000000547bdfb3 going to sleep for 11 seconds 00000100:00100000:0.0:1789583587.717405:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789583587.717414:0:3304:0:(import.c:65:import_set_state_nolock()) 000000008f48957e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789583587.717419:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789583587.717422:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002055b8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332215808:0@lo:38: 00000100:00100000:0.0:1789583587.717455:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332215936 00000100:00100000:0.0:1789583587.717461:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332215936 00000100:00100000:0.0:1789583587.717514:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789583587.717521:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2732f48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5877:x1876514332215936:12345-0@lo:502: 00000100:00100000:0.0:1789583587.717760:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2732f48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5877:x1876514332215936:12345-0@lo:502: Request processed in 239us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583587.717768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789583587.717830:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000743fbd1c pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5877:1876514332215936:0@lo:502: 00000040:00080000:0.0:1789583587.717856:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1789583587.719212:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1789583587.719239:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789583587.719260:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.719272:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 000000005c05d75d/0x6d3e73d72c6e2bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789583587.719328:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789583587.719331:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789583587.719332:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583587.719334:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583587.719335:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583587.719337:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583587.719338:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789583587.719339:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789583587.719340:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789583587.719342:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789583587.719343:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583587.719344:0:5829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789583587.719347:0:5829:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1789583587.719350:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789583587.719351:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789583587.719352:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583587.719360:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583587.719361:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583587.719362:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583587.719363:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789583587.719364:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789583587.719364:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789583587.719365:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789583587.719366:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583587.719367:0:5829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789583587.719400:0:5829:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789583587.719415:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f706a3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332216064:0@lo:253: 00000100:00100000:2.0:1789583587.719468:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.719492:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fe7e037d going to sleep for 11 seconds 00000100:00100000:2.0:1789583587.719517:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216064 00000100:00100000:2.0:1789583587.719523:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216064 00000100:00100000:2.0:1789583587.719555:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789583587.719562:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b70b654b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5829:x1876514332216064:12345-0@lo:253: 20000000:01000000:2.0:1789583587.719581:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789583587.719592:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789583587.788859:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789583587.788877:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789583587.789577:0:5864:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789583587.789583:0:5864:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789583587.789606:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.789624:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.789631:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.789665:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.789691:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 12 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.789719:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009544e7a5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5864:1876514332216192:0@lo:104: 00000100:00100000:2.0:1789583587.789783:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583587.789894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216192 00000100:00100000:1.0:1789583587.789901:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216192 00000100:00100000:1.0:1789583587.789941:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583587.789949:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b723c58c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5864:x1876514332216192:12345-0@lo:104: 00010000:00010000:1.0:1789583587.789959:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790003:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789583587.790008:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c7ab061 going to sleep for 11 seconds 00000100:00100000:1.0:1789583587.790008:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b723c58c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5864:x1876514332216192:12345-0@lo:104: Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583587.790015:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583587.790028:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009544e7a5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5864:1876514332216192:0@lo:104: 00010000:00010000:2.0:1789583587.790044:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790044:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583587.790049:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790055:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e0e32961 already unused, calling callback (000000007c2a240e) 10000000:00010000:1.0:1789583587.790058:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790064:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583587.790082:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583587.790088:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583587.790112:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790118:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583587.790142:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790148:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 00000000e0e32961/0x6d3e73d72c6e2ba2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ba9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583587.790162:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583587.790164:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583587.790165:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583587.793245:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001332d03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332216320:0@lo:103: 00000100:00100000:3.0:1789583587.793339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583587.793521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216320 00000100:00100000:2.0:1789583587.793529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216320 00010000:00010000:2.0:1789583587.793561:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 13 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583587.793595:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583587.793601:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000da660b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3306:x1876514332216320:12345-0@lo:103: 00010000:00010000:2.0:1789583587.793615:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583587.793620:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 13 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793629:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 13 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793643:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fd92a821/0x6d3e73d72c6e2ba9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ba2 expref: 13 pid: 5842 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793657:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793664:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789583587.793695:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004113169s 00010000:00010000:2.0:1789583587.793699:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793705:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793714:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793719:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793725:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000198fc4fa already unused, calling callback (000000000ff25d57) 00010000:00010000:2.0:1789583587.793727:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793733:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793748:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793757:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583587.793789:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000da660b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3306:x1876514332216320:12345-0@lo:103: Request processed in 188us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583587.793796:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789583587.793845:0:5864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793862:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583587.793867:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000198fc4fa/0x6d3e73d72c6e2bda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583587.794216:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001332d03a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332216320:0@lo:103: 00000100:00100000:2.0:1789583587.802764:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b70b654b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5829:x1876514332216064:12345-0@lo:253: Request processed in 83194us (83287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583587.802778:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789583587.802949:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f706a3c pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5829:1876514332216064:0@lo:253: 10000000:01000000:0.0:1789583587.802963:0:5829:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789583587.802966:0:5829:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789583587.802968:0:5829:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583587.802969:0:5829:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583587.802970:0:5829:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583587.802971:0:5829:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583587.802972:0:5829:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583587.802973:0:5829:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583587.802974:0:5829:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583587.802975:0:5829:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789583587.802976:0:5829:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789583587.802977:0:5829:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583587.802978:0:5829:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789583587.802990:0:5829:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789583587.809360:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583587.809708:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583587.810153:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583587.810409:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583587.810605:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583587.810790:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583587.811744:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583587.812178:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583587.812452:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583587.812628:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583587.812860:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583587.813215:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1789583587.882005:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1789583587.888166:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789583587.923129:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789583587.923290:0:5882:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789583587.923295:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789583587.923602:0:5883:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789583587.926360:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789583587.926499:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789583587.926950:0:5829:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789583587.926957:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789583587.927070:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789583587.929599:0:5829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789583587.930458:0:5829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789583587.930496:0:5829:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789583587.930763:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789583587.931448:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789583587.933489:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789583587.933673:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789583587.935661:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789583587.937213:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789583587.937409:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789583587.937552:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789583587.938063:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789583587.938395:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789583587.938568:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789583587.938865:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789583587.939560:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789583587.939754:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789583587.940033:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789583587.940343:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789583587.940472:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789583587.940604:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789583587.941428:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789583587.941573:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789583587.941839:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789583587.942635:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789583587.942906:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789583587.943451:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789583587.943580:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789583587.943727:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789583587.944380:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789583587.944533:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789583587.944668:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789583587.944844:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789583587.945048:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789583587.945363:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789583587.945506:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789583587.945637:0:5829:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789583587.945884:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789583587.987164:0:5883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789583588.027623:0:5829:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789583588.027668:0:5829:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab7802a0b988 00100000:10000000:0.0:1789583588.027685:0:5829:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789583588.029063:0:5829:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789583588.029077:0:5829:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789583588.029090:0:5829:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789583588.029108:0:5829:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789583588.078173:0:5883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789583588.078255:0:5883:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789583588.078259:0:5883:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1789583588.919111:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583589.929212:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583590.954763:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583591.974915:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789583592.285892:0:6126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789583592.999132:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789583592.999172:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789583592.999175:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b666645000 from 3 10000000:01000000:0.0:1789583592.999179:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789583592.999223:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583592.999243:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583592.999254:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583592.999319:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b95e95d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332216448:0@lo:101: 00000100:00100000:0.0:1789583592.999381:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583592.999423:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c30a6409 going to sleep for 11 seconds 00000100:00100000:1.0:1789583592.999535:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216448 00000100:00100000:1.0:1789583592.999543:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216448 00000100:00100000:1.0:1789583592.999587:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789583592.999594:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076702430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5845:x1876514332216448:12345-0@lo:101: 00010000:00010000:1.0:1789583592.999606:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583592.999617:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000934db0e5/0x6d3e73d72c6e2be8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2be1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583592.999636:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000934db0e5/0x6d3e73d72c6e2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583592.999655:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000934db0e5/0x6d3e73d72c6e2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583592.999663:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000934db0e5, rc 0) 00000100:00100000:1.0:1789583592.999704:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076702430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332216448:12345-0@lo:101: Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583592.999710:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789583592.999783:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b95e95d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332216448:0@lo:101: 00010000:00010000:3.0:1789583592.999798:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583592.999828:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583592.999875:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e7c33aa3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332216576:0@lo:256: 00000100:00100000:3.0:1789583592.999933:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583592.999958:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab32dcad going to sleep for 11 seconds 00000100:00100000:1.0:1789583593.000066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216576 00000100:00100000:1.0:1789583593.000070:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216576 00000100:00100000:1.0:1789583593.000091:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789583593.000096:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f38f98c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332216576:12345-0@lo:256: 20000000:01000000:1.0:1789583593.000109:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789583593.000125:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789583593.000128:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789583593.000199:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f38f98c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332216576:12345-0@lo:256: Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583593.000209:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789583593.000246:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e7c33aa3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332216576:0@lo:256: 10000000:01000000:1.0:1789583593.000283:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789583593.000288:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583593.000295:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: 00000000eb78cb6a/0x6d3e73d72c6e2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789583593.004157:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789583593.004165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789583593.004169:0:36:0:(import.c:65:import_set_state_nolock()) 000000008f48957e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789583593.004186:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008f48957e using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789583593.004217:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001fb47ea5 x1876514332216704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789583593.004461:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001fb47ea5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332216704:0@lo:38: 00000100:00100000:2.0:1789583593.004556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583593.004669:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216704 00000100:00100000:3.0:1789583593.004675:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216704 00000100:00100000:3.0:1789583593.004710:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583593.004716:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009544e7a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876514332216704:12345-0@lo:38: 00010000:00080000:3.0:1789583593.004746:0:5850:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:3.0:1789583593.004945:0:5850:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6d3e73d72c6e2bef 00000004:00100000:3.0:1789583593.004994:0:5850:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789583593.005093:0:5850:0:(import.c:65:import_set_state_nolock()) 000000003821e770 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789583593.005148:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009544e7a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876514332216704:12345-0@lo:38: Request processed in 432us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583593.005155:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789583593.005227:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001fb47ea5 x1876514332216704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789583603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789583593.005250:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789583593.005256:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789583593.005260:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789583593.005262:0:3304:0:(import.c:65:import_set_state_nolock()) 000000008f48957e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789583593.005267:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001fb47ea5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332216704:0@lo:38: 00010000:00010000:0.0:1789583594.028267:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583595.047199:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583596.071846:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583597.100586:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789583597.290476:0:6328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5afe0660 20000000:00000080:3.0:1789583597.290494:0:6328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b66d163c00 uarg=0000000000000000 20000000:01000000:3.0:1789583597.290526:0:6328:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789583597.290533:0:6328:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789583597.290537:0:6328:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789583597.291271:0:6328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789583597.291286:0:6328:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789583597.307095:0:6328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583597.307709:0:6328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789583597.307785:0:6328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789583597.307873:0:6328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789583597.307894:0:6328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789583597.308442:0:6328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583597.308467:0:6328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583597.308475:0:6328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583597.308527:0:6328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583597.308561:0:6328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 11 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583597.308578:0:6328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c7f0afaa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6328:1876514332216832:0@lo:104: 00000100:00100000:3.0:1789583597.308679:0:6328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583597.308741:0:6328:0:(client.c:2716:ptlrpc_set_wait()) set 000000002db785f6 going to sleep for 11 seconds 00000100:00100000:1.0:1789583597.308900:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216832 00000100:00100000:1.0:1789583597.308911:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216832 00000100:00100000:1.0:1789583597.308986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789583597.308996:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f91d818c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:6328:x1876514332216832:12345-0@lo:104: 00010000:00010000:1.0:1789583597.309012:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583597.309084:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583597.309089:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f91d818c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:6328:x1876514332216832:12345-0@lo:104: Request processed in 96us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583597.309097:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789583597.309186:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583597.309197:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.309310:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dd950608 already unused, calling callback (000000007c2a240e) 10000000:00010000:2.0:1789583597.309320:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.309330:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583597.309342:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583597.309348:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789583597.309356:0:6328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c7f0afaa pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6328:1876514332216832:0@lo:104: 00010000:00010000:3.0:1789583597.309384:0:6328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.309411:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.309421:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789583597.309450:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.309464:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: 00000000dd950608/0x6d3e73d72c6e2bb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2bb7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.309489:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583597.309491:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583597.309492:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583597.309635:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332216960:0@lo:103: 00000100:00100000:3.0:1789583597.309677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583597.309743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332216960 00000100:00100000:2.0:1789583597.309761:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332216960 00010000:00010000:2.0:1789583597.309802:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 12 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583597.311980:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583597.312132:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7f0afaa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3307:x1876514332216960:12345-0@lo:103: 00010000:00010000:2.0:1789583597.312151:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583597.312157:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 12 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312168:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 12 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312182:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b52c7331/0x6d3e73d72c6e2bb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bb0 expref: 12 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312196:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312203:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312279:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312287:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312292:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312298:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312304:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071ad69e9 already unused, calling callback (000000000ff25d57) 00010000:00010000:2.0:1789583597.312307:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312319:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312339:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583597.312351:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583597.312416:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7f0afaa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:3307:x1876514332216960:12345-0@lo:103: Request processed in 424us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583597.312423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583597.312470:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332216960:0@lo:103: 00010000:00010000:1.0:1789583597.312528:0:6328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583597.312536:0:6328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583597.312552:0:6328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071ad69e9/0x6d3e73d72c6e2bf6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583598.119172:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583598.119422:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583598.119485:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006a812403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332217216:0@lo:400: 00000100:00100000:1.0:1789583598.119553:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583598.119685:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217216 00000100:00100000:2.0:1789583598.119693:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217216 00000100:00100000:2.0:1789583598.119741:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583598.119750:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000027c93863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332217216:12345-0@lo:400: 00000100:00100000:2.0:1789583598.119801:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000027c93863 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332217216:12345-0@lo:400: Request processed in 52us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583598.119827:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789583598.119863:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006a812403 x1876514332217216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583598.119876:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006a812403 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332217216:0@lo:400: 00000100:00100000:0.0:1789583598.120395:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4f9d656 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332217088:0@lo:400: 00000100:00100000:0.0:1789583598.120434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583598.120560:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217088 00000100:00100000:1.0:1789583598.120565:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217088 00000100:00100000:1.0:1789583598.120612:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789583598.120620:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c8c473f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:3307:x1876514332217088:12345-0@lo:400: 00000100:00100000:1.0:1789583598.120666:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c8c473f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:3307:x1876514332217088:12345-0@lo:400: Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583598.120672:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789583598.120742:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4f9d656 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332217088:0@lo:400: 00010000:00010000:1.0:1789583599.145970:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583600.172098:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583601.197041:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789583602.215473:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789583602.215481:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666645000 from 1 10000000:01000000:2.0:1789583602.215492:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789583602.215530:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: 00000000cf67cf47/0x6d3e73d72c6e2bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583602.215542:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: 00000000cf67cf47/0x6d3e73d72c6e2bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583602.215552:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: 00000000cf67cf47/0x6d3e73d72c6e2bfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583602.215604:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332217344:0@lo:101: 00000100:00100000:2.0:1789583602.215666:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583602.215715:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a907e902 going to sleep for 11 seconds 00000100:00100000:3.0:1789583602.215884:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217344 00000100:00100000:3.0:1789583602.215891:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217344 00000100:00100000:3.0:1789583602.215939:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789583602.215947:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f924d89d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:5845:x1876514332217344:12345-0@lo:101: 00010000:00010000:3.0:1789583602.215960:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583602.215971:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029f4c2ee/0x6d3e73d72c6e2c04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2bfd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583602.215992:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029f4c2ee/0x6d3e73d72c6e2c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583602.216002:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029f4c2ee/0x6d3e73d72c6e2c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583602.216010:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029f4c2ee, rc 0) 00000100:00100000:3.0:1789583602.216053:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f924d89d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332217344:12345-0@lo:101: Request processed in 107us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583602.216060:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789583602.216204:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332217344:0@lo:101: 00010000:00010000:2.0:1789583602.216218:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: 00000000cf67cf47/0x6d3e73d72c6e2bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583602.216226:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: 00000000cf67cf47/0x6d3e73d72c6e2bfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583602.216273:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332217472:0@lo:501: 00000100:00100000:2.0:1789583602.216297:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583602.216316:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a907e902 going to sleep for 11 seconds 00000100:00100000:1.0:1789583602.216414:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217472 00000100:00100000:1.0:1789583602.216419:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217472 00000100:00100000:1.0:1789583602.216446:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789583602.216452:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000021a0854b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332217472:12345-0@lo:501: 00000100:00100000:1.0:1789583602.216721:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000021a0854b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332217472:12345-0@lo:501: Request processed in 269us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583602.216727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789583602.216842:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332217472:0@lo:501: 00000100:00100000:2.0:1789583602.216866:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332217600:0@lo:503: 00000100:00100000:2.0:1789583602.216902:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583602.216918:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a907e902 going to sleep for 11 seconds 00000100:00100000:1.0:1789583602.216962:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217600 00000100:00100000:1.0:1789583602.216966:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217600 00000100:00100000:1.0:1789583602.216995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789583602.217001:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e7375a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332217600:12345-0@lo:503: 00000100:00100000:1.0:1789583602.217290:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e7375a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332217600:12345-0@lo:503: Request processed in 289us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583602.217304:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789583602.218338:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000075dfa523 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332217600:0@lo:503: 00000100:00100000:3.0:1789583602.218655:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000072aca729 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6659:1876514332217728:0@lo:502: 00000100:00100000:3.0:1789583602.218714:0:6659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583602.218750:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f92c0187 going to sleep for 11 seconds 00000100:00100000:2.0:1789583602.218790:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217728 00000100:00100000:2.0:1789583602.218800:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217728 00000100:00100000:2.0:1789583602.218859:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789583602.218866:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006bf0bed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6659:x1876514332217728:12345-0@lo:502: 00000100:00100000:2.0:1789583602.219055:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006bf0bed5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6659:x1876514332217728:12345-0@lo:502: Request processed in 189us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583602.219062:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789583602.223290:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583602.223410:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000072aca729 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6659:1876514332217728:0@lo:502: 00000020:01000000:3.0:1789583602.223455:0:6659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583602.223465:0:6659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583602.223468:0:6659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789583602.223475:0:6659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b666645000 00000020:00000080:3.0:1789583602.223478:0:6659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789583602.223534:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6659:1876514332217856:0@lo:502: 00000100:00100000:3.0:1789583602.223611:0:6659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583602.223658:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645a2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583602.223708:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217856 00000100:00100000:1.0:1789583602.223715:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217856 00000100:00100000:1.0:1789583602.223764:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789583602.223773:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6659:x1876514332217856:12345-0@lo:502: 00000100:00100000:1.0:1789583602.223983:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6659:x1876514332217856:12345-0@lo:502: Request processed in 209us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583602.223991:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789583602.224553:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6659:1876514332217856:0@lo:502: 00000020:01000000:3.0:1789583602.224584:0:6659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583602.224590:0:6659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583602.224592:0:6659:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789583602.224596:0:6659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789583602.224763:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789583602.224786:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789583602.224795:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583602.224830:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.240524:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332217984:0@lo:400: 00000100:00100000:3.0:1789583603.240602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.240671:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332218112:0@lo:400: 00000100:00100000:3.0:1789583603.240701:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.240738:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332217984 00000100:00100000:3.0:1789583603.240756:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332217984 00000100:00100000:3.0:1789583603.240800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789583603.240837:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3306:x1876514332217984:12345-0@lo:400: 00000100:00100000:3.0:1789583603.240885:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3306:x1876514332217984:12345-0@lo:400: Request processed in 51us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.240891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789583603.240922:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218112 00000100:00100000:3.0:1789583603.240925:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218112 00000100:00100000:3.0:1789583603.240950:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583603.240957:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332218112:12345-0@lo:400: 00000100:00100000:3.0:1789583603.240991:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332218112:12345-0@lo:400: Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.240997:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789583603.241036:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b64a1ddc00 x1876514332218112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583603.241050:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332218112:0@lo:400: 00000100:00100000:3.0:1789583603.241207:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332217984:0@lo:400: 00010000:00010000:2.0:1789583603.242255:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789583603.298513:0:6700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789583603.298517:0:6700:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789583603.298670:0:6700:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b64a171800 00000020:01000004:1.0:1789583603.298685:0:6700:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789583603.298696:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789583603.298709:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88b648de99c0) 00000020:00000080:1.0:1789583603.298724:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789583603.311274:0:6700:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789583603.311520:0:6700:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789583603.329766:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789583603.334100:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789583603.334134:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789583603.334254:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789583603.334285:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789583603.334623:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789583603.334633:0:6700:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789583603.334643:0:6700:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d3e73d72c6e2c12 00000020:01000004:0.0:1789583603.334650:0:6700:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789583603.334669:0:6700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789583603.334672:0:6700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789583603.334678:0:6700:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789583603.334682:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789583603.334701:0:6700:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88b67c5b0000) 00000020:00000080:0.0:1789583603.334713:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1789583603.336246:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583603.336412:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789583603.336418:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789583603.341655:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789583603.341666:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789583603.342067:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789583603.342074:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789583603.343523:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789583603.343884:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789583603.343897:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789583603.345975:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789583603.345987:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789583603.367284:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789583603.367519:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789583603.367525:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789583603.369710:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789583603.369725:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789583603.370394:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789583603.370401:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789583603.373465:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789583603.373685:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789583603.373693:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789583603.374346:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789583603.374352:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789583603.416404:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583603.416633:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789583603.416640:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789583603.418469:0:6700:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789583603.418480:0:6700:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789583603.419168:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789583603.419190:0:6700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789583603.419196:0:6700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789583603.440042:0:6700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789583603.440078:0:6700:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789583603.440082:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789583603.440083:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789583603.440084:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583603.440085:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583603.440087:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583603.440088:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583603.440089:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789583603.440090:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789583603.440091:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789583603.440092:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583603.440093:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789583603.440096:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789583603.440098:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789583603.440099:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789583603.440100:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583603.440101:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583603.440102:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583603.440103:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583603.440104:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789583603.440105:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789583603.440106:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789583603.440107:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583603.440108:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789583603.440131:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789583603.440154:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332218240:0@lo:253: 00000100:00100000:2.0:1789583603.440229:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583603.440354:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66e123e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.440397:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218240 00000100:00100000:3.0:1789583603.440405:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218240 00000100:00100000:3.0:1789583603.440452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789583603.440460:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332218240:12345-0@lo:253: 20000000:01000000:3.0:1789583603.440487:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789583603.440491:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789583603.440495:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789583603.440498:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789583603.442631:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583603.442869:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789583603.442897:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789583603.442942:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789583603.442962:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789583603.443000:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789583603.443056:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789583603.443477:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789583603.443496:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789583603.443498:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789583603.443534:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789583603.443542:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789583603.443688:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789583603.443698:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789583603.443732:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789583603.443742:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789583603.443771:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789583603.443865:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789583603.444887:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789583603.444906:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789583603.444908:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789583603.444941:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789583603.444959:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789583603.444994:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789583603.445003:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789583603.445046:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789583603.445055:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789583603.445086:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789583603.445122:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789583603.445138:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789583603.445140:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789583603.445144:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789583603.445156:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789583603.445164:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789583603.445197:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789583603.445200:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789583603.446115:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1789583603.446183:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1789583603.446237:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789583603.446509:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789583603.446551:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789583603.446619:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789583603.446632:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789583603.446633:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789583603.448473:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789583603.448544:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789583603.448615:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789583603.449106:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789583603.449151:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789583603.449203:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789583603.449217:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789583603.449219:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789583603.449641:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789583603.451653:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789583603.451697:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789583603.451760:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789583603.451777:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789583603.451779:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789583603.451788:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789583603.452181:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452199:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452207:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452213:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452219:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452273:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452286:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 12 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.452298:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5842:1876514332218368:0@lo:104: 00000100:00100000:3.0:1789583603.452358:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789583603.452440:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452449:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 12 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.452457:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5842:1876514332218496:0@lo:104: 00000100:00100000:3.0:1789583603.452474:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789583603.452553:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.452571:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 12 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.452580:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5842:1876514332218624:0@lo:104: 00000100:00100000:3.0:1789583603.452602:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583603.452651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218368 00000100:00100000:2.0:1789583603.452659:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218368 00000100:00100000:2.0:1789583603.452691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218496 00000100:00100000:2.0:1789583603.452694:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218496 00000100:00100000:2.0:1789583603.452705:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789583603.452713:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:5842:x1876514332218368:12345-0@lo:104: 00010000:00010000:2.0:1789583603.452726:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.452785:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789583603.452791:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:5842:x1876514332218368:12345-0@lo:104: Request processed in 79us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583603.452798:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789583603.452847:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789583603.452853:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5842:x1876514332218496:12345-0@lo:104: 00010000:00010000:2.0:1789583603.452860:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.452891:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789583603.452895:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5842:x1876514332218496:12345-0@lo:104: Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583603.452901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789583603.452917:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789583603.452923:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.452942:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:2.0:1789583603.452946:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.452973:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583603.452980:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583603.452986:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789583603.453014:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453020:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789583603.453041:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453048:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e2bbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2bc5 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453072:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583603.453075:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453081:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216e400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:2.0:1789583603.453084:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453103:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583603.453109:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583603.453114:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789583603.453128:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453134:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789583603.453147:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453152:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b68216e400/0x6d3e73d72c6e2b4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2b55 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453163:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583603.453164:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583603.453166:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583603.453297:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332218752:0@lo:103: 00000100:00100000:3.0:1789583603.453324:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.453362:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332218880:0@lo:103: 00000100:00100000:3.0:1789583603.453397:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789583603.453401:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583603.453430:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.453451:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5842:1876514332218368:0@lo:104: 00000100:00100000:3.0:1789583603.453463:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5842:1876514332218496:0@lo:104: 00000100:00100000:1.0:1789583603.453479:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218624 00000100:00100000:1.0:1789583603.453485:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218624 00000100:00100000:2.0:1789583603.453609:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789583603.453619:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5842:x1876514332218624:12345-0@lo:104: 00010000:00010000:2.0:1789583603.453629:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.453631:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218752 00000100:00100000:1.0:1789583603.453636:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218752 00010000:00010000:1.0:1789583603.453659:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 13 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.453681:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583603.453682:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332218880 00000100:00100000:1.0:1789583603.453687:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332218880 00000100:00100000:2.0:1789583603.453691:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5842:x1876514332218624:12345-0@lo:104: Request processed in 72us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583603.453700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789583603.453703:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.453723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583603.453737:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:3308:x1876514332218752:12345-0@lo:103: 00010000:00010000:1.0:1789583603.453747:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583603.453753:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.453763:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.453774:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e2bc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bbe expref: 14 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.453785:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583603.453837:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583603.453842:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.453848:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640031600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583603.453851:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.453858:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583603.453864:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583603.453869:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583603.453892:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.453899:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5842:1876514332218624:0@lo:104: 00010000:00010000:0.0:1789583603.453901:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583603.453921:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.453927:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.453930:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2b39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.453945:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332219008:0@lo:103: 00000100:00100000:3.0:1789583603.453970:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789583603.454050:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583603.454052:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583603.454054:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583603.454153:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3308:x1876514332218752:12345-0@lo:103: Request processed in 416us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.454160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583603.454171:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219008 00000100:00100000:1.0:1789583603.454175:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219008 00010000:00010000:1.0:1789583603.454186:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 13 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.454198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789583603.454204:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3305:x1876514332218880:12345-0@lo:103: 00010000:00010000:1.0:1789583603.454211:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583603.454215:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 13 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454225:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 13 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583603.454232:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332218752:0@lo:103: 00010000:00010000:1.0:1789583603.454236:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b640030000/0x6d3e73d72c6e2b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b4e expref: 13 pid: 5842 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454253:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583603.454329:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3305:x1876514332218880:12345-0@lo:103: Request processed in 124us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.454335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789583603.454346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789583603.454352:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:3306:x1876514332219008:12345-0@lo:103: 00010000:00010000:1.0:1789583603.454358:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583603.454362:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 11 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454370:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 11 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454380:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2b39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2b32 expref: 11 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454391:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454398:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454410:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454417:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454424:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454437:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454443:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583603.454447:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454454:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454474:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.454482:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583603.454514:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:3306:x1876514332219008:12345-0@lo:103: Request processed in 163us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.454520:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583603.454589:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332219008:0@lo:103: 00010000:00010000:2.0:1789583603.454622:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.454630:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332218880:0@lo:103: 00010000:00010000:2.0:1789583603.454633:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.454642:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789583603.454656:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789583603.491466:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:6700:x1876514332218240:12345-0@lo:253: Request processed in 50998us (51228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.491479:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789583603.491595:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332218240:0@lo:253: 10000000:01000000:0.0:1789583603.491610:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789583603.491614:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789583603.491615:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789583603.491617:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583603.491618:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789583603.491619:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583603.491620:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583603.491621:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583603.491623:0:6700:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789583603.491624:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583603.491625:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789583603.491656:0:6700:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b64a171800 from lustre-OST0000 10000000:01000000:0.0:1789583603.491681:0:6700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789583603.491683:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789583603.491689:0:6700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88b648de8000 local copy 10000000:01000000:0.0:1789583603.491694:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789583603.491752:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.491762:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.491770:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583603.491788:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219136:0@lo:101: 00000100:00100000:0.0:1789583603.491857:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.491905:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.492193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219136 00000100:00100000:3.0:1789583603.492201:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219136 00000100:00100000:3.0:1789583603.492242:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789583603.492250:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:6700:x1876514332219136:12345-0@lo:101: 00010000:00010000:3.0:1789583603.492262:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583603.492275:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641482e00/0x6d3e73d72c6e2c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2c27 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.492296:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641482e00/0x6d3e73d72c6e2c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c27 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.492307:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641482e00/0x6d3e73d72c6e2c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c27 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.492327:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482e00, rc 0) 00000100:00100000:3.0:1789583603.492365:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:6700:x1876514332219136:12345-0@lo:101: Request processed in 116us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.492371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789583603.492532:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219136:0@lo:101: 00010000:00010000:0.0:1789583603.492545:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.492554:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583603.492646:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219264:0@lo:501: 00000100:00100000:0.0:1789583603.492670:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.492689:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.492739:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219264 00000100:00100000:3.0:1789583603.492743:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219264 00000100:00100000:3.0:1789583603.492772:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789583603.492778:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:6700:x1876514332219264:12345-0@lo:501: 00000100:00100000:3.0:1789583603.493097:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:6700:x1876514332219264:12345-0@lo:501: Request processed in 318us (425us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789583603.493104:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789583603.493213:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219264:0@lo:501: 10000000:01000000:0.0:1789583603.493226:0:6700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789583603.493252:0:6700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789583603.493257:0:6700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493265:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493272:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493328:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789583603.493346:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b64a171800 10000000:01000000:0.0:1789583603.493351:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789583603.493355:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88b648de8000 10000000:01000000:0.0:1789583603.493363:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789583603.493367:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88b648de8000 from 1 10000000:01000000:0.0:1789583603.493369:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789583603.493387:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493395:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493403:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583603.493414:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219392:0@lo:101: 00000100:00100000:0.0:1789583603.493438:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.493467:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.493517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219392 00000100:00100000:3.0:1789583603.493521:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219392 00000100:00100000:3.0:1789583603.493552:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789583603.493559:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+10:6700:x1876514332219392:12345-0@lo:101: 00010000:00010000:3.0:1789583603.493576:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583603.493587:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c3c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2c35 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.493601:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c35 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.493611:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c3c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c35 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.493618:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482400, rc 0) 00000100:00100000:3.0:1789583603.493645:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332219392:12345-0@lo:101: Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.493657:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789583603.493731:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219392:0@lo:101: 00010000:00010000:0.0:1789583603.493741:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493749:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583603.493763:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789583603.493781:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493788:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583603.493794:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789583603.493802:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789583603.493823:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789583603.493826:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789583603.493839:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493846:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.493853:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583603.493863:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219520:0@lo:101: 00000100:00100000:0.0:1789583603.493887:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.493901:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.493973:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219520 00000100:00100000:3.0:1789583603.493977:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219520 00000100:00100000:3.0:1789583603.494007:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789583603.494013:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332219520:12345-0@lo:101: 00010000:00010000:3.0:1789583603.494019:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583603.494026:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2c43 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.494039:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.494047:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.494053:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482200, rc 0) 00000100:00100000:3.0:1789583603.494080:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332219520:12345-0@lo:101: Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.494086:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789583603.494316:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219520:0@lo:101: 00010000:00010000:0.0:1789583603.494326:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.494333:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583603.494392:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219648:0@lo:501: 00000100:00100000:0.0:1789583603.494417:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.494430:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583603.494444:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219648 00000100:00100000:0.0:1789583603.494449:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219648 00000100:00100000:0.0:1789583603.494480:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789583603.494486:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332219648:12345-0@lo:501: 00000100:00100000:0.0:1789583603.494664:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332219648:12345-0@lo:501: Request processed in 177us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583603.494671:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789583603.494700:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219648:0@lo:501: 00000100:00100000:0.0:1789583603.494723:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219776:0@lo:503: 00000100:00100000:0.0:1789583603.494757:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.494771:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583603.494783:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219776 00000100:00100000:0.0:1789583603.494787:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219776 00000100:00100000:0.0:1789583603.494958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789583603.494965:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332219776:12345-0@lo:503: 00000100:00100000:0.0:1789583603.495097:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332219776:12345-0@lo:503: Request processed in 132us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583603.495103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789583603.495142:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219776:0@lo:503: 00000040:00080000:0.0:1789583603.495521:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789583603.495723:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219904:0@lo:502: 00000100:00100000:0.0:1789583603.495762:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.495857:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a658e40 going to sleep for 11 seconds 00010000:00010000:1.0:1789583603.495916:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583603.495924:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.495932:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640031600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583603.495936:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.495945:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583603.495957:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583603.495970:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583603.495992:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.495998:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583603.496022:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.496030:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b640031600/0x6d3e73d72c6e2c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d3e73d72c6e2c2e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.496043:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583603.496045:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583603.496046:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583603.496126:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583603.496137:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332220032:0@lo:103: 00000100:00100000:0.0:1789583603.496227:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583603.496294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220032 00000100:00100000:1.0:1789583603.496300:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220032 00000100:00100000:1.0:1789583603.496344:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583603.496352:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3308:x1876514332220032:12345-0@lo:103: 00010000:00010000:1.0:1789583603.496361:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583603.496372:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641482e00/0x6d3e73d72c6e2c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c27 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.496383:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583603.496412:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:3308:x1876514332220032:12345-0@lo:103: Request processed in 61us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.496418:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583603.496485:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332220032:0@lo:103: 00000100:00100000:2.0:1789583603.496593:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332219904 00000100:00100000:2.0:1789583603.496598:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332219904 00000100:00100000:2.0:1789583603.496664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789583603.496671:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332219904:12345-0@lo:502: 00000100:00100000:2.0:1789583603.496857:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332219904:12345-0@lo:502: Request processed in 187us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583603.496863:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789583603.496967:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332219904:0@lo:502: 00000040:00080000:1.0:1789583603.497250:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789583603.497309:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789583603.497347:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789583603.497397:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789583603.497436:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789583603.497473:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789583603.497500:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220160:0@lo:502: 00000100:00100000:1.0:1789583603.497537:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583603.498668:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583603.498750:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220160 00000100:00100000:0.0:1789583603.498758:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220160 00000100:00100000:0.0:1789583603.498801:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789583603.498832:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332220160:12345-0@lo:502: 00000100:00100000:0.0:1789583603.499025:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332220160:12345-0@lo:502: Request processed in 194us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583603.499032:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789583603.499212:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220160:0@lo:502: 00000040:00080000:1.0:1789583603.499321:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789583603.499333:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789583603.499886:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789583603.499893:0:6718:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789583603.499898:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583603.499901:0:6718:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789583603.499905:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789583603.499919:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88b648decd40) 00000020:00000080:1.0:1789583603.499937:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789583603.499942:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789583603.500714:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b64a171800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789583603.500724:0:6718:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789583603.500731:0:6718:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d3e73d72c6e2c58 00010000:00010000:1.0:1789583603.508359:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789583603.508635:0:6718:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789583603.510652:0:6718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789583603.510918:0:6718:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789583603.521352:0:6718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789583603.521906:0:6718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789583603.524660:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789583603.524670:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583603.524675:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583603.524677:0:6718:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789583603.524681:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583603.524685:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583603.524686:0:6718:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789583603.524689:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789583603.524691:0:6718:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789583603.524744:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583603.524747:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583603.524749:0:6718:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789583603.524752:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789583603.525778:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789583603.525821:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789583603.525841:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.525859:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583603.525868:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b64a171800 from 1 10000000:01000000:1.0:1789583603.525870:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789583603.525906:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.525915:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.525926:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.525961:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220288:0@lo:101: 00000100:00100000:1.0:1789583603.526025:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583603.526080:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813a6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583603.526392:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220288 00000100:00100000:0.0:1789583603.526400:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220288 00000100:00100000:0.0:1789583603.526444:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789583603.526454:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:6700:x1876514332220288:12345-0@lo:101: 00010000:00010000:0.0:1789583603.526466:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583603.526477:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2c5f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.526499:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.526509:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.526527:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640031e00, rc 0) 00000100:00100000:0.0:1789583603.526585:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220288:12345-0@lo:101: Request processed in 132us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583603.526592:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583603.527332:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220288:0@lo:101: 00010000:00010000:1.0:1789583603.527348:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.527357:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.527446:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220416:0@lo:501: 00000100:00100000:1.0:1789583603.527477:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583603.527509:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813a6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583603.527619:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220416 00000100:00100000:3.0:1789583603.527624:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220416 00000100:00100000:3.0:1789583603.528736:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789583603.528748:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220416:12345-0@lo:501: 00000100:00100000:3.0:1789583603.529358:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220416:12345-0@lo:501: Request processed in 612us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583603.529365:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789583603.529655:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220416:0@lo:501: 00000100:00100000:3.0:1789583603.529721:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220544:0@lo:503: 00000100:00100000:3.0:1789583603.529762:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.530620:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789583603.532420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220544 00000100:00100000:2.0:1789583603.532432:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220544 00000100:00100000:2.0:1789583603.532525:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789583603.532535:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220544:12345-0@lo:503: 00000100:00100000:2.0:1789583603.532871:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220544:12345-0@lo:503: Request processed in 338us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583603.532879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789583603.533032:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220544:0@lo:503: 00000040:00080000:3.0:1789583603.533445:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789583603.533517:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220672:0@lo:502: 00000100:00100000:3.0:1789583603.533557:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.533606:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789583603.533641:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220672 00000100:00100000:2.0:1789583603.533645:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220672 00000100:00100000:2.0:1789583603.533699:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789583603.533706:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220672:12345-0@lo:502: 00000100:00100000:3.0:1789583603.533887:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220672:0@lo:502: 00000100:00100000:2.0:1789583603.534249:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220672:12345-0@lo:502: Request processed in 449us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583603.534257:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:3.0:1789583603.534442:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789583603.534484:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789583603.534504:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220800:0@lo:502: 00000100:00100000:3.0:1789583603.534535:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.535995:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789583603.537033:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220800 00000100:00100000:1.0:1789583603.537043:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220800 00000100:00100000:1.0:1789583603.537096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789583603.537105:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220800:12345-0@lo:502: 00000100:00100000:1.0:1789583603.537525:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220800:12345-0@lo:502: Request processed in 419us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.537533:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789583603.537641:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220800:0@lo:502: 00000040:00080000:3.0:1789583603.537780:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789583603.537795:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789583603.538539:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583603.538549:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583603.538552:0:6722:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789583603.538558:0:6722:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b64a171800 00000020:00000080:2.0:1789583603.538572:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789583603.538592:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583603.538595:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583603.538596:0:6722:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789583603.538599:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789583603.538736:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789583603.538754:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583603.538771:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.538783:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583603.539036:0:6700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789583603.539045:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b64a171800 10000000:01000000:3.0:1789583603.539048:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b64a171800 10000000:01000000:3.0:1789583603.539052:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789583603.539057:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b64a171800 from 1 10000000:01000000:3.0:1789583603.539060:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789583603.539092:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.539100:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.539109:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.539127:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220928:0@lo:101: 00000100:00100000:3.0:1789583603.539231:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.539296:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583603.539342:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332220928 00000100:00100000:0.0:1789583603.539349:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332220928 00000100:00100000:0.0:1789583603.539418:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789583603.539426:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332220928:12345-0@lo:101: 00010000:00010000:0.0:1789583603.539437:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583603.539449:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2c6d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.539469:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.539480:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.539487:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640030c00, rc 0) 00000100:00100000:0.0:1789583603.539529:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332220928:12345-0@lo:101: Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583603.539535:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789583603.539609:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332220928:0@lo:101: 00010000:00010000:3.0:1789583603.539622:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583603.539631:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583603.539703:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221056:0@lo:501: 00000100:00100000:3.0:1789583603.539727:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.539791:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583603.539987:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221056 00000100:00100000:1.0:1789583603.539992:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221056 00000100:00100000:1.0:1789583603.540012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789583603.540019:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221056:12345-0@lo:501: 00000100:00100000:1.0:1789583603.540247:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221056:12345-0@lo:501: Request processed in 228us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.540254:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789583603.540325:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221056:0@lo:501: 00000100:00100000:3.0:1789583603.540351:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221184:0@lo:503: 00000100:00100000:3.0:1789583603.540394:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.540420:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583603.540523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221184 00000100:00100000:1.0:1789583603.540527:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221184 00000100:00100000:1.0:1789583603.540544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789583603.540550:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221184:12345-0@lo:503: 00000100:00100000:1.0:1789583603.540694:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221184:12345-0@lo:503: Request processed in 143us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.540701:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789583603.540775:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221184:0@lo:503: 00000040:00080000:3.0:1789583603.541038:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789583603.541089:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221312:0@lo:502: 00000100:00100000:3.0:1789583603.541123:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.541139:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583603.541252:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221312 00000100:00100000:1.0:1789583603.541256:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221312 00000100:00100000:1.0:1789583603.541275:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789583603.541280:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221312:12345-0@lo:502: 00000100:00100000:1.0:1789583603.541409:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221312:12345-0@lo:502: Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.541424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789583603.541499:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221312:0@lo:502: 00000040:00080000:3.0:1789583603.541736:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789583603.541782:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789583603.541848:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789583603.541896:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789583603.541932:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789583603.542004:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789583603.542044:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789583603.542079:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789583603.542128:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789583603.542435:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789583603.542475:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789583603.542525:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789583603.542570:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789583603.542609:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789583603.542681:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789583603.542722:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789583603.542759:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789583603.542831:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789583603.542871:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789583603.542907:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789583603.542956:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789583603.542992:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789583603.543038:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789583603.543088:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789583603.543126:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789583603.543432:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789583603.543485:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789583603.543521:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789583603.543570:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221440:0@lo:502: 00000100:00100000:3.0:1789583603.543631:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583603.543700:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541c0a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583603.543801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221440 00000100:00100000:2.0:1789583603.543833:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221440 00000100:00100000:1.0:1789583603.544269:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789583603.544280:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221440:12345-0@lo:502: 00000100:00100000:1.0:1789583603.544483:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221440:12345-0@lo:502: Request processed in 205us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.544490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789583603.544602:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221440:0@lo:502: 00000040:00080000:0.0:1789583603.544680:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789583603.544693:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789583603.545314:0:6723:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789583603.545329:0:6723:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88b67c5b3380) 00000020:00000080:0.0:1789583603.545356:0:6723:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789583603.545426:0:6723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b64a171800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789583603.545429:0:6723:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b64a171800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789583603.545432:0:6723:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b64a171800 3 00010000:00080000:0.0:1789583603.545458:0:6723:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b66de38800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789583603.547317:0:6723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789583603.547527:0:6723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789583603.547572:0:6723:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789583603.547585:0:6723:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6d3e73d72c6e2c82 00000100:00080000:0.0:1789583603.547594:0:6723:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789583603.547604:0:6723:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88b66de38800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789583603.547638:0:6723:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67af5ce00 x1876514332221568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789583603.547678:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876514332221568:0@lo:38: 00000100:00100000:0.0:1789583603.547737:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583603.547797:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221568 00000100:00100000:0.0:1789583603.547803:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221568 00000100:00100000:0.0:1789583603.547860:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583603.547867:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1876514332221568:12345-0@lo:38: 00010000:00080000:0.0:1789583603.547888:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1789583603.547925:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6d3e73d72c6e2c89 00000004:00100000:0.0:1789583603.547939:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789583603.547967:0:5849:0:(import.c:65:import_set_state_nolock()) ffff88b676cd0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583603.548013:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876514332221568:12345-0@lo:38: Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583603.548020:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789583603.548054:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b67af5ce00 x1876514332221568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789583613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583603.548076:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789583603.548083:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789583603.548090:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789583603.548094:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789583603.548096:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b66de38800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789583603.548101:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876514332221568:0@lo:38: 00000100:00080000:0.0:1789583603.548119:0:6723:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1789583603.551395:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789583603.551534:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789583603.551568:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789583603.551589:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.551602:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789583603.551645:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789583603.551647:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789583603.551649:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583603.551650:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583603.551651:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583603.551652:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583603.551654:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583603.551655:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789583603.551656:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789583603.551658:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583603.551659:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583603.551663:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789583603.551665:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789583603.551666:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789583603.551667:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583603.551668:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583603.551669:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583603.551670:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583603.551676:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583603.551677:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789583603.551677:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789583603.551678:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583603.551679:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583603.551702:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789583603.551719:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221696:0@lo:253: 00000100:00100000:1.0:1789583603.551791:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583603.551854:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221696 00000100:00100000:1.0:1789583603.551861:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221696 00000100:00100000:1.0:1789583603.551899:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789583603.551907:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:6700:x1876514332221696:12345-0@lo:253: 20000000:01000000:1.0:1789583603.551930:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789583603.551943:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789583603.552398:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645a2f300 going to sleep for 11 seconds 20000000:01000000:1.0:1789583603.574785:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789583603.574864:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789583603.575063:0:5864:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789583603.575069:0:5864:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789583603.575089:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.575108:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.575116:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.575154:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583603.575179:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 13 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583603.575207:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5864:1876514332221824:0@lo:104: 00000100:00100000:2.0:1789583603.575264:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583603.575314:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66e123600 going to sleep for 11 seconds 00000100:00100000:1.0:1789583603.575415:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221824 00000100:00100000:1.0:1789583603.575422:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221824 00000100:00100000:1.0:1789583603.575469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789583603.575480:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5864:x1876514332221824:12345-0@lo:104: 00010000:00010000:1.0:1789583603.575492:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575553:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583603.575559:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5864:x1876514332221824:12345-0@lo:104: Request processed in 81us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.575574:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789583603.575595:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583603.575602:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575620:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640030200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583603.575623:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575631:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583603.575638:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583603.575643:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583603.575669:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575676:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583603.575692:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575699:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b640030200/0x6d3e73d72c6e2be1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2be8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575714:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583603.575716:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583603.575718:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583603.575738:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332221952:0@lo:103: 00000100:00100000:1.0:1789583603.575769:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583603.575835:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332221952 00000100:00100000:1.0:1789583603.575839:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332221952 00010000:00010000:1.0:1789583603.575857:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 14 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.575886:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789583603.575893:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:3308:x1876514332221952:12345-0@lo:103: 00010000:00010000:1.0:1789583603.575904:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583603.575909:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 14 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575919:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 14 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575935:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575942:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789583603.575954:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004113169s 00010000:00010000:1.0:1789583603.575958:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575965:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575972:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575978:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.575983:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216e400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583603.575987:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.576001:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.576010:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583603.576019:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583603.576048:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:3308:x1876514332221952:12345-0@lo:103: Request processed in 156us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.576055:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789583603.576109:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332221952:0@lo:103: 00010000:00010000:0.0:1789583603.576213:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfb600/0x6d3e73d72c6e2be8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2be1 expref: 13 pid: 5841 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583603.576224:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5864:1876514332221824:0@lo:104: 00010000:00010000:0.0:1789583603.576238:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.576247:0:5864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.576253:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583603.576259:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2c90 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583603.583773:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:6700:x1876514332221696:12345-0@lo:253: Request processed in 31858us (31974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583603.583788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789583603.584016:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:6700:1876514332221696:0@lo:253: 10000000:01000000:3.0:1789583603.584031:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789583603.584034:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789583603.584036:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789583603.584037:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789583603.584039:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789583603.584040:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789583603.584041:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789583603.584043:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789583603.584044:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789583603.584046:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789583603.584047:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789583603.584049:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789583603.584061:0:6700:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789583603.588286:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583603.588453:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789583603.588650:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583603.588835:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789583603.589017:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583603.589464:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789583603.590498:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789583603.757364:0:6700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789583603.757381:0:6700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789583603.757414:0:6700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789583603.757465:0:6700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789583603.757479:0:6700:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789583603.757508:0:6700:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789583604.264032:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583605.287240:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583606.310924:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583607.335649:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583608.369752:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583608.871012:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332222080:0@lo:400: 00000100:00100000:0.0:1789583608.871012:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332222208:0@lo:400: 00000100:00100000:0.0:1789583608.876822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583608.879227:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222208 00000100:00100000:2.0:1789583608.879237:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222208 00000100:00100000:2.0:1789583608.879284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789583608.879293:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332222208:12345-0@lo:400: 00000100:00100000:2.0:1789583608.879371:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332222208:12345-0@lo:400: Request processed in 78us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583608.879378:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583608.879562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583608.879651:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332222336:0@lo:400: 00010000:00080000:0.0:1789583608.879664:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b64a1dc000 x1876514332222208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583608.879696:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332222208:0@lo:400: 00000100:00100000:3.0:1789583608.879703:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583608.879775:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222336 00000100:00100000:3.0:1789583608.879779:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222336 00000100:00100000:3.0:1789583608.879827:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583608.879834:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332222336:12345-0@lo:400: 00000100:00100000:3.0:1789583608.879875:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332222336:12345-0@lo:400: Request processed in 42us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583608.879881:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789583608.879897:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583608.879914:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b64a1ddf80 x1876514332222336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583608.879923:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332222336:0@lo:400: 00000100:00100000:2.0:1789583608.880109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222080 00000100:00100000:2.0:1789583608.880114:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222080 00000100:00100000:2.0:1789583608.880154:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789583608.880162:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3305:x1876514332222080:12345-0@lo:400: 00000100:00100000:2.0:1789583608.880198:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3305:x1876514332222080:12345-0@lo:400: Request processed in 37us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583608.880205:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789583608.882665:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332222080:0@lo:400: 00010000:00010000:0.0:1789583609.384649:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789583609.983319:0:7070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789583610.410650:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789583610.921859:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789583610.921868:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b666645000 from 21 10000000:01000000:1.0:1789583610.921874:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789583610.921922:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583610.921935:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583610.921948:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583610.921973:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332222464:0@lo:101: 00000100:00100000:1.0:1789583610.922054:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583610.922104:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.923500:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222464 00000100:00100000:3.0:1789583610.923522:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222464 00000100:00100000:3.0:1789583610.923619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789583610.923630:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332222464:12345-0@lo:101: 00010000:00010000:3.0:1789583610.923646:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583610.923675:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2c97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.923702:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.923713:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.923723:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483a00, rc 0) 00000100:00100000:3.0:1789583610.923788:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332222464:12345-0@lo:101: Request processed in 160us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.923795:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789583610.924020:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332222464:0@lo:101: 00010000:00010000:3.0:1789583610.924038:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.924048:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583610.924109:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332222592:0@lo:501: 00000100:00100000:3.0:1789583610.924141:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583610.924156:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6adc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583610.924332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222592 00000100:00100000:0.0:1789583610.924337:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222592 00000100:00100000:0.0:1789583610.924377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789583610.924385:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332222592:12345-0@lo:501: 00000100:00100000:0.0:1789583610.924721:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332222592:12345-0@lo:501: Request processed in 336us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583610.924728:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789583610.924952:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332222592:0@lo:501: 00000100:00100000:3.0:1789583610.924985:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332222720:0@lo:503: 00000100:00100000:3.0:1789583610.925023:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583610.925046:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6adc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.925056:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222720 00000100:00100000:3.0:1789583610.925065:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222720 00000100:00100000:3.0:1789583610.925089:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789583610.925095:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332222720:12345-0@lo:503: 00000100:00100000:3.0:1789583610.925368:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332222720:12345-0@lo:503: Request processed in 273us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.925376:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789583610.925388:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332222720:0@lo:503: 00000100:00100000:1.0:1789583610.926872:0:7114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648881f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7114:1876514332222848:0@lo:502: 00000100:00100000:1.0:1789583610.926938:0:7114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583610.926973:0:7114:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583610.927456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222848 00000100:00100000:2.0:1789583610.927463:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222848 00000100:00100000:2.0:1789583610.927598:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789583610.927608:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7114:x1876514332222848:12345-0@lo:502: 00000100:00100000:2.0:1789583610.931460:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7114:x1876514332222848:12345-0@lo:502: Request processed in 3847us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583610.931473:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789583610.932308:0:7114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648881f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7114:1876514332222848:0@lo:502: 00000100:00100000:0.0:1789583610.932401:0:7114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7114:1876514332222976:0@lo:502: 00000100:00100000:0.0:1789583610.932462:0:7114:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583610.932687:0:7114:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789583610.933783:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332222976 00000100:00100000:2.0:1789583610.933794:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332222976 00000100:00100000:2.0:1789583610.934614:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789583610.934626:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7114:x1876514332222976:12345-0@lo:502: 00000100:00100000:2.0:1789583610.934933:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7114:x1876514332222976:12345-0@lo:502: Request processed in 309us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583610.934941:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789583610.935046:0:7114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7114:1876514332222976:0@lo:502: 00000040:00080000:1.0:1789583610.935083:0:7114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789583610.935873:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789583610.935895:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789583610.935905:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.935917:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583610.935926:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789583610.935928:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b666645000 from 4 10000000:01000000:3.0:1789583610.935931:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789583610.935964:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.935972:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.935981:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583610.936001:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223104:0@lo:101: 00000100:00100000:3.0:1789583610.936046:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583610.939903:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583610.939983:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223104 00000100:00100000:0.0:1789583610.939992:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223104 00000100:00100000:0.0:1789583610.940039:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789583610.940048:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332223104:12345-0@lo:101: 00010000:00010000:0.0:1789583610.940063:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583610.940081:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2ca5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583610.940107:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583610.940118:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583610.940132:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640030200, rc 0) 00000100:00100000:0.0:1789583610.940200:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332223104:12345-0@lo:101: Request processed in 153us (4154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583610.940207:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789583610.940290:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223104:0@lo:101: 00010000:00010000:3.0:1789583610.940384:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.940393:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583610.941864:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223232:0@lo:256: 00000100:00100000:3.0:1789583610.941925:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583610.941963:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.943045:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223232 00000100:00100000:3.0:1789583610.943055:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223232 00000100:00100000:3.0:1789583610.943097:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789583610.943107:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332223232:12345-0@lo:256: 20000000:01000000:3.0:1789583610.943127:0:5841:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789583610.943147:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789583610.943150:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789583610.943256:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332223232:12345-0@lo:256: Request processed in 150us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.943264:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789583610.944404:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223232:0@lo:256: 10000000:01000000:3.0:1789583610.944465:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789583610.944474:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.944485:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583610.944494:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789583610.944501:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789583610.944504:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789583610.944543:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.944559:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.944568:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583610.944724:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223360:0@lo:101: 00000100:00100000:3.0:1789583610.944928:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583610.944963:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.944983:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223360 00000100:00100000:3.0:1789583610.944989:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223360 00000100:00100000:3.0:1789583610.945023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789583610.945031:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332223360:12345-0@lo:101: 00010000:00010000:3.0:1789583610.945042:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583610.945053:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2cb3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.945074:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.945084:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.945092:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483c00, rc 0) 00000100:00100000:3.0:1789583610.945123:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332223360:12345-0@lo:101: Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.945133:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789583610.945165:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223360:0@lo:101: 00010000:00010000:3.0:1789583610.945176:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583610.945186:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583610.945229:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223488:0@lo:501: 00000100:00100000:3.0:1789583610.945252:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583610.945265:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6adcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.945276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223488 00000100:00100000:3.0:1789583610.945280:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223488 00000100:00100000:3.0:1789583610.946390:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789583610.946403:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332223488:12345-0@lo:501: 00000100:00100000:3.0:1789583610.947006:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332223488:12345-0@lo:501: Request processed in 604us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.947014:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789583610.947856:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223488:0@lo:501: 00000100:00100000:2.0:1789583610.947905:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223616:0@lo:503: 00000100:00100000:2.0:1789583610.947958:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583610.947984:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b542f5bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.947989:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223616 00000100:00100000:3.0:1789583610.947996:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223616 00000100:00100000:3.0:1789583610.948039:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789583610.948047:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332223616:12345-0@lo:503: 00000100:00100000:3.0:1789583610.948415:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332223616:12345-0@lo:503: Request processed in 369us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.948423:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789583610.948432:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332223616:0@lo:503: 00000100:00100000:2.0:1789583610.949671:0:7118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7118:1876514332223744:0@lo:502: 00000100:00100000:2.0:1789583610.949725:0:7118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583610.949761:0:7118:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b542f5b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789583610.949876:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223744 00000100:00100000:3.0:1789583610.949889:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223744 00000100:00100000:3.0:1789583610.949931:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789583610.949939:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:7118:x1876514332223744:12345-0@lo:502: 00000100:00100000:3.0:1789583610.950165:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:7118:x1876514332223744:12345-0@lo:502: Request processed in 226us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583610.950171:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789583610.950441:0:7118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7118:1876514332223744:0@lo:502: 00000020:01000000:2.0:1789583610.950465:0:7118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789583610.950472:0:7118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789583610.950479:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583610.950481:0:7118:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789583610.950486:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789583610.950490:0:7118:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:2.0:1789583610.950528:0:7118:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789583610.950531:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789583610.950545:0:7118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88b67c4b99c0) 00000020:00000080:2.0:1789583610.950564:0:7118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789583610.950575:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789583610.950653:0:7118:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789583610.950659:0:7118:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789583610.950666:0:7118:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2cc8 00010000:00080000:2.0:1789583610.950693:0:7118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b6620e0800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789583610.950935:0:7118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789583611.013359:0:7118:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789583611.013389:0:7118:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789583611.013957:0:7118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789583611.014094:0:7118:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789583611.014150:0:7118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789583611.014197:0:7118:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789583611.017040:0:7125:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789583611.017047:0:7125:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789583611.018616:0:7118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789583611.018628:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789583611.018660:0:7118:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789583611.018681:0:7118:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e2ccf 00000100:00080000:0.0:1789583611.018691:0:7118:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789583611.018701:0:7118:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88b6620e0800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789583611.018735:0:7118:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67af5fb80 x1876514332223872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789583611.018763:0:7118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789583611.018845:0:7118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583611.018850:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583611.018852:0:7118:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789583611.018855:0:7118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583611.018858:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583611.018859:0:7118:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789583611.018862:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789583611.018875:0:7118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789583611.018903:0:7118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7118:1876514332224000:0@lo:502: 00000100:00100000:0.0:1789583611.018971:0:7118:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.019013:0:7118:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583611.019148:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332223872:0@lo:8: 00000100:00100000:1.0:1789583611.019188:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.019319:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332223872 00000100:00100000:0.0:1789583611.019327:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332223872 00000100:00100000:0.0:1789583611.019435:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583611.019442:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876514332223872:12345-0@lo:8: 00010000:00080000:0.0:1789583611.019464:0:6702:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1789583611.019488:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e2cd6 00002000:00100000:0.0:1789583611.019535:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88b676cd2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789583611.019540:0:6702:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789583611.019544:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789583611.019660:0:6702:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1789583611.019718:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224000 00000100:00100000:3.0:1789583611.019722:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224000 00002000:00080000:0.0:1789583611.019797:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1789583611.019828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789583611.019837:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:7118:x1876514332224000:12345-0@lo:502: 00000100:00080000:0.0:1789583611.019930:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b676cd0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583611.019980:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876514332223872:12345-0@lo:8: Request processed in 536us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583611.019987:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789583611.020235:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:7118:x1876514332224000:12345-0@lo:502: Request processed in 400us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583611.020242:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789583611.020286:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332224128:0@lo:400: 00000100:00100000:3.0:1789583611.020456:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583611.020601:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332224256:0@lo:400: 00000100:00100000:3.0:1789583611.020626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583611.020664:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224128 00000100:00100000:3.0:1789583611.020669:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224128 00000100:00100000:3.0:1789583611.020696:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224256 00000100:00100000:3.0:1789583611.020699:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224256 00000100:00100000:3.0:1789583611.020720:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583611.020726:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332224128:12345-0@lo:400: 00000100:00100000:3.0:1789583611.021235:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332224128:12345-0@lo:400: Request processed in 374us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583611.021245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583611.021262:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789583611.021277:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332224256:12345-0@lo:400: 00000100:00100000:3.0:1789583611.021453:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332224256:12345-0@lo:400: Request processed in 176us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583611.021460:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789583611.021576:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b64a1ddf80 x1876514332224256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583611.021592:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332224256:0@lo:400: 00000100:00080000:3.0:1789583611.021648:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583611.021668:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b64a1dd180 x1876514332224128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583611.021677:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332224128:0@lo:400: 00000100:00100000:3.0:1789583611.021704:0:7118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7118:1876514332224000:0@lo:502: 00000020:01000000:3.0:1789583611.021733:0:7118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583611.021740:0:7118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583611.021743:0:7118:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789583611.021748:0:7118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1789583611.022226:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789583611.022244:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789583611.022253:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.022264:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583611.022273:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789583611.022275:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b648de8000 from 1 10000000:01000000:3.0:1789583611.022278:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789583611.022847:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.022857:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.022874:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583611.022891:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332224384:0@lo:101: 00000100:00100000:3.0:1789583611.022932:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583611.022952:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645a2f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789583611.022970:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224384 00000100:00100000:3.0:1789583611.022975:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224384 00000100:00100000:3.0:1789583611.023066:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789583611.023075:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332224384:12345-0@lo:101: 00010000:00010000:3.0:1789583611.023085:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583611.023599:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2cdd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.023628:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.023638:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.023646:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03400, rc 0) 00000100:00100000:3.0:1789583611.023689:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332224384:12345-0@lo:101: Request processed in 615us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583611.023695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789583611.023742:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332224384:0@lo:101: 00010000:00010000:3.0:1789583611.024082:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583611.024449:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1789583611.024475:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b67af5fb80 x1876514332223872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789583621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583611.024485:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789583611.024492:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789583611.024516:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789583611.024523:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789583611.024526:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6620e0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789583611.024543:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789583611.024548:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332223872:0@lo:8: 00000004:00080000:1.0:1789583611.024700:0:7125:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789583611.024786:0:7125:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 168008978664ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789583611.024877:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332224512:0@lo:501: 00000100:00100000:3.0:1789583611.024918:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583611.025451:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645a2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789583611.028272:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224512 00000100:00100000:1.0:1789583611.028286:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224512 00000100:00100000:1.0:1789583611.028579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789583611.028590:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332224512:12345-0@lo:501: 00000100:00100000:1.0:1789583611.028852:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332224512:12345-0@lo:501: Request processed in 264us (3932us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583611.028860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789583611.033610:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332224512:0@lo:501: 10000000:01000000:1.0:1789583611.033655:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789583611.033664:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583611.033676:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789583611.091151:0:7126:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789583611.091178:0:7126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332224768:0@lo:7: 00000100:00100000:0.0:1789583611.091258:0:7126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.091296:0:7126:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7240 going to sleep for 11 seconds 00000004:00080000:0.0:1789583611.091323:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789583611.091413:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789583611.091425:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332224640:0@lo:13: 00000100:00100000:0.0:1789583611.091452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.091590:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224768 00000100:00100000:0.0:1789583611.091598:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224768 00000100:00100000:0.0:1789583611.091658:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583611.091667:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7126:x1876514332224768:12345-0@lo:7: 00000100:00080000:2.0:1789583611.091760:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583611.094912:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224640 00000100:00100000:1.0:1789583611.094925:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224640 00000100:00100000:1.0:1789583611.094981:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583611.095116:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332224640:12345-0@lo:13: 00002000:00000024:1.0:1789583611.095150:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789583611.095225:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332224640:12345-0@lo:13: Request processed in 237us (3772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583611.095232:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789583611.098501:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b67af5f800 x1876514332224640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583611.098540:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332224640:0@lo:13: 00002000:00080000:0.0:1789583611.104846:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789583611.104853:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789583611.104943:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7126:x1876514332224768:12345-0@lo:7: Request processed in 13273us (13680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583611.104954:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789583611.105007:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b67af5c380 x1876514332224768/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789583627 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583611.105022:0:7126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332224768:0@lo:7: 00000004:00080000:0.0:1789583611.105035:0:7126:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789583611.105071:0:7126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332224896:0@lo:5: 00000100:00100000:0.0:1789583611.105103:0:7126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.105141:0:7126:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583611.105159:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332224896 00000100:00100000:0.0:1789583611.105165:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332224896 00000100:00100000:0.0:1789583611.105202:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583611.105211:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7126:x1876514332224896:12345-0@lo:5: 00002000:00080000:0.0:1789583611.105234:0:6702:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789583611.105238:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789583611.105446:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7126:x1876514332224896:12345-0@lo:5: Request processed in 236us (341us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789583611.105453:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789583611.105483:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b67af5c380 x1876514332224896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789583627 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583611.105494:0:7126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332224896:0@lo:5: 00000004:00080000:0.0:1789583611.106410:0:7126:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789583611.106444:0:7126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332225024:0@lo:700: 00000100:00100000:0.0:1789583611.106481:0:7126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.106503:0:7126:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583611.106540:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225024 00000100:00100000:0.0:1789583611.106545:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225024 00000100:00100000:0.0:1789583611.106577:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583611.106584:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7126:x1876514332225024:12345-0@lo:700: 00000100:00100000:0.0:1789583611.106613:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1876514332225152:0@lo:700: 00000100:00100000:0.0:1789583611.106639:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583611.106653:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583611.106672:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225152 00000100:00100000:0.0:1789583611.106675:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225152 00000100:00100000:0.0:1789583611.106699:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583611.106705:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1876514332225152:12345-0@lo:700: 40000000:02000000:0.0:1789583611.202291:0:5855:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789583611.209466:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1876514332225152:12345-0@lo:700: Request processed in 102753us (102819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583611.209479:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789583611.209563:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b67af5f800 x1876514332225152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789583627 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583611.209577:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5f800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1876514332225152:0@lo:700: 40000000:02000000:3.0:1789583611.209590:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1789583611.350455:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789583611.350572:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1789583611.356567:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b67af5d180 x1876514332225024/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789583627 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583611.356583:0:7126:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789583611.356601:0:7126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332225024:0@lo:700: 00000100:00100000:3.0:1789583611.356672:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7126:x1876514332225024:12345-0@lo:700: Request processed in 249907us (250009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583611.356688:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:02000040:1.0:1789583611.398860:0:7126:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789583611.412929:0:7126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648881180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332225280:0@lo:5: 00000100:00100000:1.0:1789583611.412994:0:7126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583611.413056:0:7126:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789583611.413185:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225280 00000100:00100000:3.0:1789583611.413193:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225280 00000100:00100000:3.0:1789583611.413247:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583611.413257:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7126:x1876514332225280:12345-0@lo:5: 00002000:00080000:3.0:1789583611.424428:0:6702:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789583611.424447:0:6702:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00010000:00010000:0.0:1789583611.431286:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583611.439597:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7126:x1876514332225280:12345-0@lo:5: Request processed in 26334us (26595us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789583611.439610:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789583611.439663:0:7126:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648881180 x1876514332225280/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789583627 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583611.439680:0:7126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648881180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7126:1876514332225280:0@lo:5: 00000004:00080000:3.0:1789583611.439704:0:7126:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789583612.455190:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583613.479272:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583614.504265:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789583615.282219:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789583615.532528:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583616.041548:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332225408:0@lo:400: 00000100:00100000:3.0:1789583616.041638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583616.041718:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583616.041725:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332225536:0@lo:400: 00000100:00100000:3.0:1789583616.041750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583616.041891:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225536 00000100:00100000:3.0:1789583616.041902:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225536 00000100:00100000:3.0:1789583616.041954:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583616.041963:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332225536:12345-0@lo:400: 00000100:00100000:3.0:1789583616.042021:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332225536:12345-0@lo:400: Request processed in 59us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583616.042029:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789583616.042141:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648882d80 x1876514332225536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583616.042158:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332225536:0@lo:400: 00000100:00100000:1.0:1789583616.042374:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225408 00000100:00100000:1.0:1789583616.042379:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225408 00000100:00100000:1.0:1789583616.042415:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789583616.042423:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3307:x1876514332225408:12345-0@lo:400: 00000100:00100000:1.0:1789583616.042459:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3307:x1876514332225408:12345-0@lo:400: Request processed in 37us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583616.042465:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789583616.042565:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332225664:0@lo:400: 00000100:00100000:2.0:1789583616.042598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583616.042628:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583616.042635:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332225792:0@lo:400: 00000100:00100000:2.0:1789583616.042669:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583616.042704:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225792 00000100:00100000:2.0:1789583616.042707:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225792 00000100:00100000:2.0:1789583616.042742:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583616.042748:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332225792:12345-0@lo:400: 00000100:00100000:2.0:1789583616.042778:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332225792:12345-0@lo:400: Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583616.042784:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789583616.042803:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789583616.042861:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648883100 x1876514332225792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583616.042871:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789583616.042882:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332225792:0@lo:400: 00000100:00100000:1.0:1789583616.042943:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225664 00000100:00100000:1.0:1789583616.042947:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225664 00000100:00100000:1.0:1789583616.042979:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789583616.042985:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332225664:12345-0@lo:400: 00000100:00100000:1.0:1789583616.043017:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332225664:12345-0@lo:400: Request processed in 32us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583616.043023:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789583616.043076:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789583616.043092:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648883480 x1876514332225664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583616.043102:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332225664:0@lo:400: 00000100:00100000:3.0:1789583616.043275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332225408:0@lo:400: 00010000:00010000:2.0:1789583616.551073:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583616.551365:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332225920:0@lo:13: 00000100:00100000:2.0:1789583616.551472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583616.551762:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332225920 00000100:00100000:1.0:1789583616.551774:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332225920 00000100:00100000:1.0:1789583616.551868:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789583616.551881:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332225920:12345-0@lo:13: 00002000:00000024:1.0:1789583616.551927:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583616.551997:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332225920:12345-0@lo:13: Request processed in 119us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583616.552004:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789583616.552056:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648882680 x1876514332225920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583616.552079:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332225920:0@lo:13: 00010000:00010000:0.0:1789583617.575286:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583618.605243:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583619.630271:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583620.646934:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583621.160029:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332226048:0@lo:400: 00000100:00100000:1.0:1789583621.160110:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.160168:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789583621.160184:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332226432:0@lo:400: 00000100:00100000:1.0:1789583621.160210:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.160251:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332226176:0@lo:400: 00000100:00100000:1.0:1789583621.160276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.160293:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789583621.160299:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332226304:0@lo:400: 00000100:00100000:1.0:1789583621.160322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.160351:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226176 00000100:00100000:1.0:1789583621.160358:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226176 00000100:00100000:1.0:1789583621.160395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226304 00000100:00100000:1.0:1789583621.160398:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226304 00000100:00100000:1.0:1789583621.160426:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789583621.160448:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332226176:12345-0@lo:400: 00000100:00100000:3.0:1789583621.160477:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226048 00000100:00100000:3.0:1789583621.160481:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226048 00000100:00100000:3.0:1789583621.160510:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789583621.160513:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332226176:12345-0@lo:400: Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.160516:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3308:x1876514332226048:12345-0@lo:400: 00000100:00100000:1.0:1789583621.160520:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789583621.160535:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789583621.160541:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332226304:12345-0@lo:400: 00000100:00100000:3.0:1789583621.160551:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3308:x1876514332226048:12345-0@lo:400: Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.160558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789583621.160575:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332226304:12345-0@lo:400: Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.160580:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789583621.160582:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226432 00000100:00100000:3.0:1789583621.160591:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226432 00000100:00080000:1.0:1789583621.160594:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789583621.160619:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648883480 x1876514332226304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583621.160622:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583621.160627:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332226432:12345-0@lo:400: 00000100:00100000:1.0:1789583621.160638:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332226304:0@lo:400: 00010000:00080000:1.0:1789583621.160650:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648880a80 x1876514332226176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583621.160655:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332226432:12345-0@lo:400: Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.160659:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332226176:0@lo:400: 00000100:00100000:3.0:1789583621.160661:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789583621.160683:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789583621.160698:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648883100 x1876514332226432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583621.160707:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332226432:0@lo:400: 00000100:00100000:3.0:1789583621.160715:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332226048:0@lo:400: 00000020:01000004:3.0:1789583621.655716:0:7645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789583621.655721:0:7645:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789583621.655905:0:7645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b66de3b000 00000020:01000004:3.0:1789583621.655922:0:7645:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789583621.655936:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789583621.655951:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88b66229b380) 00000020:00000080:3.0:1789583621.655967:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00010000:00010000:3.0:1789583621.671214:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583621.673155:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583621.673183:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332226560:0@lo:13: 00000100:00100000:1.0:1789583621.673260:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583621.673545:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226560 00000100:00100000:0.0:1789583621.673554:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226560 00000100:00100000:0.0:1789583621.673628:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583621.673636:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332226560:12345-0@lo:13: 00002000:00000024:0.0:1789583621.673690:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583621.675733:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332226560:12345-0@lo:13: Request processed in 2088us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.675746:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00100000:10000000:2.0:1789583621.682335:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789583621.682602:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00080000:1.0:1789583621.690981:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648880a80 x1876514332226560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583621.691010:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332226560:0@lo:13: 00100000:10000000:2.0:1789583621.722759:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789583621.737249:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789583621.737283:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789583621.737338:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789583621.737560:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789583621.738774:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789583621.738790:0:7645:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789583621.738802:0:7645:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d3e73d72c6e2cf2 00000020:01000004:0.0:1789583621.740180:0:7645:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789583621.740208:0:7645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789583621.740213:0:7645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789583621.740221:0:7645:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789583621.740254:0:7645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789583621.740258:0:7645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789583621.786802:0:7645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789583621.786862:0:7645:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.146@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1789583621.786866:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789583621.786868:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789583621.786869:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583621.786870:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583621.786872:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583621.786873:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583621.786874:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583621.786876:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789583621.786877:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789583621.786879:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583621.786880:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583621.786884:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1789583621.786891:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789583621.786893:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789583621.786894:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583621.786894:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583621.786895:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583621.786896:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583621.786897:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583621.786898:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789583621.786899:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789583621.786900:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583621.786900:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583621.786926:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789583621.786945:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332226688:0@lo:253: 00000100:00100000:0.0:1789583621.787323:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583621.787390:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813ccb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.787888:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226688 00000100:00100000:3.0:1789583621.787897:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226688 00000100:00100000:3.0:1789583621.787958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789583621.787977:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:7645:x1876514332226688:12345-0@lo:253: 20000000:01000000:3.0:1789583621.788040:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789583621.788044:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789583621.788049:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789583621.788053:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789583621.789099:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583621.789346:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789583621.789368:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789583621.789408:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789583621.789416:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789583621.789458:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789583621.789539:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789583621.789918:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789583621.789939:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789583621.789941:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789583621.789976:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789583621.789985:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789583621.790032:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789583621.790040:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789583621.790072:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789583621.790081:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789583621.790110:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789583621.790158:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789583621.790892:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789583621.790910:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.146@tcp 20000000:01000000:3.0:1789583621.790912:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.146@tcp (null) (null) (null) 00000040:00080000:3.0:1789583621.790946:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789583621.790953:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789583621.790979:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789583621.790985:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.146@tcp (null) (null) 00000040:00080000:3.0:1789583621.791011:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789583621.791019:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789583621.791057:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789583621.791091:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789583621.791106:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789583621.791109:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789583621.791114:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789583621.791116:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789583621.791124:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789583621.791136:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789583621.791138:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789583621.791174:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789583621.791177:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789583621.794706:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789583621.794975:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789583621.795224:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789583621.795678:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789583621.795729:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789583621.795791:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789583621.795835:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789583621.795838:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789583621.796557:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789583621.799517:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789583621.799571:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789583621.799654:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789583621.799668:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789583621.799671:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789583621.801761:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789583621.801880:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789583621.801936:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789583621.802458:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789583621.802510:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789583621.802549:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789583621.802563:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789583621.802565:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789583621.807375:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789583621.807587:0:7651:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789583621.807691:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789583621.811040:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789583621.811114:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789583621.811181:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1789583621.811217:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789583621.811241:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811262:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811271:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811278:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811285:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811292:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811299:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811407:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.811422:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 16 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.811742:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332226816:0@lo:104: 00000100:00100000:2.0:1789583621.811953:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789583621.812001:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.812017:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 16 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.812026:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67bade300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332226944:0@lo:104: 00010000:00010000:2.0:1789583621.812050:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.812058:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 16 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.812066:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332227072:0@lo:104: 00010000:00010000:2.0:1789583621.812089:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.812097:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 16 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.812105:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332227200:0@lo:104: 00010000:00010000:2.0:1789583621.812126:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.812134:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 16 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.812142:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332227328:0@lo:104: 00000100:00100000:2.0:1789583621.812179:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a60f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583621.812268:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789583621.812285:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.812347:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.812462:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583621.812487:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226816 00000100:00100000:3.0:1789583621.812494:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226816 00000100:00100000:3.0:1789583621.812527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332226944 00000100:00100000:3.0:1789583621.812530:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332226944 00000100:00100000:3.0:1789583621.812538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227072 00000100:00100000:3.0:1789583621.812540:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227072 00000100:00100000:3.0:1789583621.812551:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583621.812559:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64451c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:5841:x1876514332226816:12345-0@lo:104: 00010000:00010000:3.0:1789583621.812573:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.812955:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789583621.812969:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64451c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:5841:x1876514332226816:12345-0@lo:104: Request processed in 411us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.812976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583621.813017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789583621.813023:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:5841:x1876514332226944:12345-0@lo:104: 00010000:00010000:3.0:1789583621.813031:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813066:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789583621.813071:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:5841:x1876514332226944:12345-0@lo:104: Request processed in 50us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.813076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789583621.813088:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789583621.813093:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5841:x1876514332227072:12345-0@lo:104: 00010000:00010000:3.0:1789583621.813100:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813124:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789583621.813128:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5841:x1876514332227072:12345-0@lo:104: Request processed in 36us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.813133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789583621.813151:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789583621.813153:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789583621.813157:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813165:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482e00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583621.813169:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813186:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583621.813193:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583621.813197:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789583621.813234:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813241:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789583621.813261:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813267:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e2cdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ce4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813280:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583621.813283:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813288:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb000 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583621.813291:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.813408:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332226816:0@lo:104: 00000100:00100000:2.0:1789583621.813440:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67bade300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332226944:0@lo:104: 00000100:00100000:2.0:1789583621.813447:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332227072:0@lo:104: 00000100:00100000:1.0:1789583621.813652:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.813665:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227200 00000100:00100000:1.0:1789583621.813669:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227200 00000100:00100000:0.0:1789583621.813676:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227328 00000100:00100000:0.0:1789583621.813682:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227328 00000100:00100000:1.0:1789583621.813696:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789583621.813705:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:5841:x1876514332227200:12345-0@lo:104: 00010000:00010000:1.0:1789583621.813713:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.813762:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583621.813768:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:5841:x1876514332227200:12345-0@lo:104: Request processed in 66us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.813773:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789583621.813794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583621.813799:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5841:x1876514332227328:12345-0@lo:104: 00010000:00010000:1.0:1789583621.813821:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583621.813857:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332227200:0@lo:104: 00010000:00010000:3.0:1789583621.813886:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583621.813895:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583621.813908:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789583621.813934:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813941:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789583621.813948:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813955:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e2c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c9e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813965:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583621.813968:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813973:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583621.813976:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.813982:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583621.813988:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583621.813993:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789583621.814005:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.814011:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789583621.814039:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.814046:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641483200/0x6d3e73d72c6e2c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.814057:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583621.814058:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583621.814060:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583621.814138:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583621.814152:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332227712:0@lo:103: 00010000:00010000:1.0:1789583621.814306:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583621.814312:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5841:x1876514332227328:12345-0@lo:104: Request processed in 512us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.814319:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583621.814338:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332227456:0@lo:103: 00000100:00100000:1.0:1789583621.814365:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.814394:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789583621.814400:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332227584:0@lo:103: 00000100:00100000:1.0:1789583621.814420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.814460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227456 00000100:00100000:1.0:1789583621.814464:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227456 00010000:00010000:1.0:1789583621.814495:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 17 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.814515:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227584 00000100:00100000:1.0:1789583621.814518:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227584 00010000:00010000:1.0:1789583621.814528:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 18 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.814540:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789583621.814546:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:3305:x1876514332227456:12345-0@lo:103: 00010000:00010000:1.0:1789583621.814556:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583621.814560:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 18 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.814576:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 18 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.814590:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a03400/0x6d3e73d72c6e2ce4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cdd expref: 18 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.814604:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583621.814745:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:3305:x1876514332227456:12345-0@lo:103: Request processed in 199us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.814752:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789583621.814767:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789583621.814773:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3305:x1876514332227584:12345-0@lo:103: 00010000:00010000:1.0:1789583621.814780:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583621.814784:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 16 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.814793:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 16 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.814803:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641483a00/0x6d3e73d72c6e2c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c97 expref: 16 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.814840:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583621.814863:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3305:x1876514332227584:12345-0@lo:103: Request processed in 90us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.814879:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789583621.814911:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332227584:0@lo:103: 00000100:00100000:1.0:1789583621.814919:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332227456:0@lo:103: 00010000:00010000:1.0:1789583621.815103:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583621.815108:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815115:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640030000 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583621.815118:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815126:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583621.815132:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583621.815137:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583621.815145:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815151:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482a00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583621.815154:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815161:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583621.815167:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583621.815172:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583621.815193:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815205:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583621.815214:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815220:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641482a00/0x6d3e73d72c6e2cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2cba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815231:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.815232:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.815234:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.815261:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815267:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583621.815274:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815281:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b640030000/0x6d3e73d72c6e2c43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c4a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.815478:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332227968:0@lo:103: 00000100:00100000:1.0:1789583621.815510:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.815543:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227968 00000100:00100000:1.0:1789583621.815547:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227968 00010000:00010000:1.0:1789583621.815563:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 15 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.815581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789583621.815587:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3305:x1876514332227968:12345-0@lo:103: 00010000:00010000:1.0:1789583621.815601:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583621.815606:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 15 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815614:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 15 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.815693:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583621.815721:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3305:x1876514332227968:12345-0@lo:103: Request processed in 134us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.815729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789583621.815756:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332227968:0@lo:103: 00010000:00010000:1.0:1789583621.815767:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.815769:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.815771:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583621.815995:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583621.816005:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332227840:0@lo:103: 00000100:00100000:1.0:1789583621.816030:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.816062:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227840 00000100:00100000:1.0:1789583621.816066:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227840 00010000:00010000:1.0:1789583621.816080:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 15 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.816098:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789583621.816104:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3307:x1876514332227840:12345-0@lo:103: 00010000:00010000:1.0:1789583621.816112:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583621.816116:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 15 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.816135:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 15 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.816145:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641483c00/0x6d3e73d72c6e2cba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2cb3 expref: 15 pid: 5841 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.816155:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583621.816177:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:3307:x1876514332227840:12345-0@lo:103: Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.816183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789583621.816207:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332227840:0@lo:103: 00010000:00010000:3.0:1789583621.816289:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583621.817043:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e2c4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c43 expref: 13 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583621.817061:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5841:1876514332227328:0@lo:104: 00010000:00010000:2.0:1789583621.817090:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583621.827580:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.827721:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332227712 00000100:00100000:1.0:1789583621.827732:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332227712 00010000:00010000:1.0:1789583621.827771:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 13 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.827833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583621.827844:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3308:x1876514332227712:12345-0@lo:103: 00010000:00010000:1.0:1789583621.827861:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583621.827877:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 13 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.827890:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 13 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.827908:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b640030c00/0x6d3e73d72c6e2c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c6d expref: 13 pid: 5842 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828002:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828010:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828026:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828034:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828041:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828047:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828054:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216e400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583621.828058:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828066:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828086:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.828097:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583621.828140:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3308:x1876514332227712:12345-0@lo:103: Request processed in 298us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.828155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583621.828195:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332227712:0@lo:103: 00010000:00010000:2.0:1789583621.828403:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.828413:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.828419:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2cf9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789583621.828447:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789583621.895774:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:7645:x1876514332226688:12345-0@lo:253: Request processed in 107790us (108442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.895788:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789583621.895905:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332226688:0@lo:253: 10000000:01000000:0.0:1789583621.895919:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789583621.895923:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789583621.895924:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789583621.895926:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583621.895927:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789583621.895928:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583621.895929:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583621.895947:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583621.895948:0:7645:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789583621.895950:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583621.895951:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789583621.895971:0:7645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b66de3b000 from lustre-OST0001 10000000:01000000:0.0:1789583621.896118:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789583621.896122:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789583621.896129:0:7645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88b648de8000 local copy 10000000:01000000:0.0:1789583621.896133:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789583621.896167:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.896178:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.896189:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583621.896207:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228096:0@lo:101: 00000100:00100000:0.0:1789583621.896239:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583621.896309:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.896349:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228096 00000100:00100000:3.0:1789583621.896418:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228096 00000100:00100000:3.0:1789583621.896525:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789583621.896534:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+11:7645:x1876514332228096:12345-0@lo:101: 00010000:00010000:3.0:1789583621.896547:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583621.896560:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a03600/0x6d3e73d72c6e2d07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d00 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.896591:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a03600/0x6d3e73d72c6e2d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d00 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.896602:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a03600/0x6d3e73d72c6e2d07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d00 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.896610:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03600, rc 0) 00000100:00100000:3.0:1789583621.896650:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228096:12345-0@lo:101: Request processed in 117us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.896664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789583621.896729:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228096:0@lo:101: 00010000:00010000:0.0:1789583621.896742:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.896751:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583621.896876:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228224:0@lo:501: 00000100:00100000:0.0:1789583621.896904:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583621.897285:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789583621.897432:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228224 00000100:00100000:1.0:1789583621.897439:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228224 00000100:00100000:1.0:1789583621.897466:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789583621.897473:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228224:12345-0@lo:501: 00000100:00100000:1.0:1789583621.897758:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228224:12345-0@lo:501: Request processed in 285us (853us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583621.897766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789583621.897981:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228224:0@lo:501: 10000000:01000000:0.0:1789583621.898007:0:7645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789583621.898150:0:7645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789583621.898156:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.898167:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.898174:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.898196:0:7645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789583621.898220:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b66de3b000 10000000:01000000:0.0:1789583621.898224:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789583621.898231:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789583621.898234:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789583621.898238:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789583621.898241:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789583621.898263:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.898270:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.898278:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583621.898295:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228352:0@lo:101: 00000100:00100000:0.0:1789583621.898325:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583621.898453:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228352 00000100:00100000:3.0:1789583621.898459:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228352 00000100:00100000:3.0:1789583621.898488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789583621.898495:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228352:12345-0@lo:101: 00010000:00010000:3.0:1789583621.898505:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583621.898515:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d0e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.898533:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.898544:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.898551:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03c00, rc 0) 00000100:00100000:0.0:1789583621.898598:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9480 going to sleep for 11 seconds 00010000:00010000:1.0:1789583621.898710:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583621.898716:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.898725:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cbc00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583621.898728:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.898736:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583621.898743:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583621.898748:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583621.898766:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.898773:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583621.898824:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.898831:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752cbc00/0x6d3e73d72c6e2d00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d3e73d72c6e2d07 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.898843:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.898844:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.898846:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583621.898853:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789583621.898862:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332228480:0@lo:103: 00000100:00100000:3.0:1789583621.899177:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332228352:12345-0@lo:101: Request processed in 681us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.899184:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789583621.899253:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583621.899327:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228480 00000100:00100000:2.0:1789583621.899332:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228480 00000100:00100000:2.0:1789583621.899473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583621.899482:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3305:x1876514332228480:12345-0@lo:103: 00010000:00010000:2.0:1789583621.899493:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583621.899505:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a03600/0x6d3e73d72c6e2d07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d00 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.899516:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583621.899554:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:3305:x1876514332228480:12345-0@lo:103: Request processed in 74us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583621.899568:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583621.899627:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332228480:0@lo:103: 00000100:00100000:0.0:1789583621.899733:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228352:0@lo:101: 00010000:00010000:0.0:1789583621.899748:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.899757:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583621.899854:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228608:0@lo:501: 00000100:00100000:0.0:1789583621.899895:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583621.899917:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.899970:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228608 00000100:00100000:3.0:1789583621.899974:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228608 00000100:00100000:3.0:1789583621.900010:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789583621.900016:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228608:12345-0@lo:501: 00000100:00100000:3.0:1789583621.900326:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228608:12345-0@lo:501: Request processed in 309us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.900333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789583621.900458:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228608:0@lo:501: 00000100:00100000:0.0:1789583621.900487:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228736:0@lo:503: 00000100:00100000:0.0:1789583621.900525:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583621.900548:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d9480 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.900652:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228736 00000100:00100000:3.0:1789583621.900657:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228736 00000100:00100000:3.0:1789583621.900689:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789583621.900696:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228736:12345-0@lo:503: 00000100:00100000:3.0:1789583621.900857:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228736:12345-0@lo:503: Request processed in 162us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.900864:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789583621.900902:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228736:0@lo:503: 00000040:00080000:3.0:1789583621.901273:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789583621.901327:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228864:0@lo:502: 00000100:00100000:3.0:1789583621.901504:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583621.901572:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.901938:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228864 00000100:00100000:0.0:1789583621.901945:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228864 00000100:00100000:0.0:1789583621.902129:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789583621.902140:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228864:12345-0@lo:502: 00000100:00100000:0.0:1789583621.902328:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228864:12345-0@lo:502: Request processed in 190us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.902335:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789583621.902484:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228864:0@lo:502: 00000040:00080000:1.0:1789583621.902768:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789583621.902865:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789583621.902906:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789583621.902957:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789583621.903012:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789583621.903238:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789583621.903274:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228992:0@lo:502: 00000100:00100000:1.0:1789583621.903322:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.903623:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.903734:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332228992 00000100:00100000:3.0:1789583621.903742:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332228992 00000100:00100000:3.0:1789583621.903774:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789583621.903782:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228992:12345-0@lo:502: 00000100:00100000:3.0:1789583621.903974:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332228992:12345-0@lo:502: Request processed in 192us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.903982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789583621.904210:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332228992:0@lo:502: 00000040:00080000:1.0:1789583621.904301:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789583621.904313:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789583621.905145:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789583621.905153:0:7654:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789583621.905159:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583621.905161:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789583621.905172:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789583621.905194:0:7654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88b675534d40) 00000020:00000080:1.0:1789583621.905215:0:7654:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789583621.905223:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789583621.905286:0:7654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b66de3b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789583621.905294:0:7654:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789583621.905300:0:7654:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d3e73d72c6e2d23 00010000:00010000:0.0:1789583621.912199:0:7654:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789583621.912697:0:7654:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789583621.916581:0:7654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789583621.917207:0:7654:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789583621.922133:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789583621.922876:0:7654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789583621.925082:0:7654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789583621.925096:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583621.925103:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583621.925105:0:7654:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789583621.925109:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583621.925113:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583621.925115:0:7654:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789583621.925118:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789583621.925120:0:7654:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789583621.925175:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583621.925187:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583621.925188:0:7654:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789583621.925192:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789583621.925306:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789583621.925336:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789583621.925444:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.925456:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583621.925463:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b66de3b000 from 1 10000000:01000000:1.0:1789583621.925466:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789583621.925502:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.925509:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.925519:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.925541:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229120:0@lo:101: 00000100:00100000:1.0:1789583621.925603:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.925639:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.926948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229120 00000100:00100000:0.0:1789583621.926975:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229120 00000100:00100000:0.0:1789583621.927066:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789583621.927077:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:7645:x1876514332229120:12345-0@lo:101: 00010000:00010000:0.0:1789583621.927093:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583621.927109:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d2a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.927136:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.927147:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583621.927155:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cac00, rc 0) 00000100:00100000:0.0:1789583621.927221:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229120:12345-0@lo:101: Request processed in 146us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.927227:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789583621.927419:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229120:0@lo:101: 00010000:00010000:1.0:1789583621.927451:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.927462:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.927592:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229248:0@lo:501: 00000100:00100000:1.0:1789583621.927626:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.927660:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.928135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229248 00000100:00100000:0.0:1789583621.928141:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229248 00000100:00100000:0.0:1789583621.928180:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789583621.928188:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229248:12345-0@lo:501: 00000100:00100000:0.0:1789583621.928588:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229248:12345-0@lo:501: Request processed in 399us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.928596:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789583621.928679:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229248:0@lo:501: 00000100:00100000:1.0:1789583621.928711:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229376:0@lo:503: 00000100:00100000:1.0:1789583621.928748:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.928827:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.928867:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229376 00000100:00100000:0.0:1789583621.928872:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229376 00000100:00100000:0.0:1789583621.928901:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789583621.928908:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229376:12345-0@lo:503: 00000100:00100000:0.0:1789583621.929526:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229376:12345-0@lo:503: Request processed in 616us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.929542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789583621.929611:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229376:0@lo:503: 00000040:00080000:1.0:1789583621.929948:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789583621.930163:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229504:0@lo:502: 00000100:00100000:1.0:1789583621.930207:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.930291:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.930442:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229504 00000100:00100000:0.0:1789583621.930449:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229504 00000100:00100000:0.0:1789583621.930493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789583621.930501:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229504:12345-0@lo:502: 00000100:00100000:0.0:1789583621.930717:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229504:12345-0@lo:502: Request processed in 216us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.930724:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789583621.930792:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229504:0@lo:502: 00000040:00080000:1.0:1789583621.933146:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789583621.933215:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789583621.933262:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229632:0@lo:502: 00000100:00100000:1.0:1789583621.933559:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.933650:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.933698:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229632 00000100:00100000:0.0:1789583621.933707:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229632 00000100:00100000:0.0:1789583621.933761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789583621.933772:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229632:12345-0@lo:502: 00000100:00100000:0.0:1789583621.937702:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229632:12345-0@lo:502: Request processed in 3923us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.937714:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789583621.937730:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229632:0@lo:502: 00000040:00080000:1.0:1789583621.937930:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789583621.937945:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789583621.938570:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583621.938579:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583621.938581:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789583621.938589:0:7658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b66de3b000 00000020:00000080:2.0:1789583621.938592:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789583621.938611:0:7658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583621.938614:0:7658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583621.938615:0:7658:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789583621.938618:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789583621.938745:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789583621.938765:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789583621.938787:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.938799:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583621.938872:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789583621.938875:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b66de3b000 10000000:01000000:1.0:1789583621.938878:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b66de3b000 10000000:01000000:1.0:1789583621.938882:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789583621.938888:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b66de3b000 from 1 10000000:01000000:1.0:1789583621.938890:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789583621.938927:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.938937:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.938947:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.938965:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229760:0@lo:101: 00000100:00100000:1.0:1789583621.939505:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.939571:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.939690:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229760 00000100:00100000:3.0:1789583621.939696:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229760 00000100:00100000:2.0:1789583621.939907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789583621.939919:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332229760:12345-0@lo:101: 00010000:00010000:2.0:1789583621.939937:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583621.939951:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d38 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.939974:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.939984:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583621.939992:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216e400, rc 0) 00000100:00100000:2.0:1789583621.940077:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332229760:12345-0@lo:101: Request processed in 161us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583621.940084:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789583621.940148:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229760:0@lo:101: 00010000:00010000:1.0:1789583621.940163:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.940187:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.940290:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229888:0@lo:501: 00000100:00100000:1.0:1789583621.940333:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.940461:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.940462:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332229888 00000100:00100000:0.0:1789583621.940467:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332229888 00000100:00100000:0.0:1789583621.940566:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789583621.940572:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332229888:12345-0@lo:501: 00000100:00100000:0.0:1789583621.941117:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332229888:12345-0@lo:501: Request processed in 543us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.941125:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789583621.941204:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332229888:0@lo:501: 00000100:00100000:1.0:1789583621.941236:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230016:0@lo:503: 00000100:00100000:1.0:1789583621.941278:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.941322:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.941331:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230016 00000100:00100000:0.0:1789583621.941335:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230016 00000100:00100000:0.0:1789583621.941478:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789583621.941487:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230016:12345-0@lo:503: 00000100:00100000:0.0:1789583621.941837:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230016:12345-0@lo:503: Request processed in 351us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.941844:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789583621.942047:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230016:0@lo:503: 00000040:00080000:1.0:1789583621.942546:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789583621.942642:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230144:0@lo:502: 00000100:00100000:1.0:1789583621.942691:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583621.942719:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230144 00000100:00100000:1.0:1789583621.942729:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.942787:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230144 00000100:00100000:3.0:1789583621.942853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789583621.942863:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230144:12345-0@lo:502: 00000100:00100000:3.0:1789583621.943269:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230144:12345-0@lo:502: Request processed in 407us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.943277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789583621.943303:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230144:0@lo:502: 00000040:00080000:1.0:1789583621.944184:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789583621.944251:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789583621.944288:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789583621.944708:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789583621.945072:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789583621.945130:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789583621.945168:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789583621.945199:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789583621.945246:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789583621.945281:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789583621.946244:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789583621.946577:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789583621.946692:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789583621.946795:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789583621.946964:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789583621.947003:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789583621.947039:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789583621.947089:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789583621.947126:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789583621.947193:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789583621.947243:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789583621.947280:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789583621.947453:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789583621.947957:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789583621.948005:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789583621.948044:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789583621.948095:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789583621.948132:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789583621.948168:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789583621.948215:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789583621.948247:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789583621.948275:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789583621.948408:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789583621.948477:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789583621.948663:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789583621.948916:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789583621.948954:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789583621.949018:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230272:0@lo:502: 00000100:00100000:1.0:1789583621.949115:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.949221:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64551c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789583621.949275:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230272 00000100:00100000:0.0:1789583621.949285:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230272 00000100:00100000:0.0:1789583621.949486:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789583621.949505:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230272:12345-0@lo:502: 00000100:00100000:0.0:1789583621.949801:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230272:12345-0@lo:502: Request processed in 306us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583621.949835:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789583621.949929:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230272:0@lo:502: 00000040:00080000:1.0:1789583621.950017:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789583621.950029:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789583621.952928:0:7659:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789583621.952954:0:7659:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88b675530000) 00000020:00000080:1.0:1789583621.952979:0:7659:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1789583621.953068:0:7659:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b66de3b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789583621.953072:0:7659:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b66de3b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789583621.953075:0:7659:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b66de3b000 3 00010000:00080000:1.0:1789583621.953102:0:7659:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b67525b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.146@tcp at head 00010000:00010000:1.0:1789583621.957193:0:7659:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1789583621.957470:0:7659:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789583621.957578:0:7659:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789583621.957655:0:7659:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6d3e73d72c6e2d4d 00000100:00080000:1.0:1789583621.957665:0:7659:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789583621.957676:0:7659:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88b67525b800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789583621.957714:0:7659:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b648883100 x1876514332230400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789583621.958100:0:7659:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789583621.958173:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876514332230400:0@lo:38: 00000100:00100000:3.0:1789583621.958235:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789583621.958797:0:7659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789583621.958866:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789583621.959238:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789583621.959255:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.959267:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789583621.959477:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789583621.959480:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789583621.959481:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789583621.959482:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789583621.959484:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789583621.959486:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789583621.959488:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789583621.959489:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789583621.959490:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789583621.959560:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789583621.959562:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789583621.959566:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789583621.959568:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789583621.959570:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789583621.959570:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789583621.959571:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789583621.959572:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789583621.959573:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789583621.959574:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789583621.959575:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789583621.959577:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789583621.959577:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789583621.959578:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789583621.959666:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789583621.959681:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230528:0@lo:253: 00000100:00100000:3.0:1789583621.959795:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583621.959842:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.959881:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230528 00000100:00100000:3.0:1789583621.959889:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230528 00000100:00100000:3.0:1789583621.959939:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789583621.959948:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:7645:x1876514332230528:12345-0@lo:253: 20000000:01000000:3.0:1789583621.959974:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1789583621.960125:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230400 00000100:00100000:1.0:1789583621.960131:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230400 00000100:00100000:1.0:1789583621.960155:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789583621.960161:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876514332230400:12345-0@lo:38: 00010000:00080000:1.0:1789583621.960199:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:1.0:1789583621.960247:0:5848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6d3e73d72c6e2d54 00000004:00100000:1.0:1789583621.960261:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789583621.960312:0:5848:0:(import.c:65:import_set_state_nolock()) ffff88b67525d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789583621.960374:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876514332230400:12345-0@lo:38: Request processed in 212us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.960386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:3.0:1789583621.960705:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789583621.961924:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b648883100 x1876514332230400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789583631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583621.961936:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789583621.961944:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789583621.961951:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789583621.961956:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789583621.961959:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b67525b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789583621.961966:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876514332230400:0@lo:38: 00000100:00100000:3.0:1789583621.962071:0:7660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dfb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876514332230656:0@lo:901: 00000100:00100000:3.0:1789583621.962120:0:7660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583621.962149:0:7660:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789583621.962312:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230656 00000100:00100000:1.0:1789583621.962319:0:5859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230656 00000100:00100000:1.0:1789583621.962377:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583621.962386:0:5859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876514332230656:12345-0@lo:901: 00000100:00100000:1.0:1789583621.962739:0:5859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7660:x1876514332230656:12345-0@lo:901: Request processed in 353us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.962747:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789583621.963120:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583621.963148:0:7660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b64a1dfb80 x1876514332230656/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789583637 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583621.963160:0:7660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dfb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7660:1876514332230656:0@lo:901: 20000000:01000000:3.0:1789583621.993720:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789583621.993925:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789583621.994167:0:5864:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789583621.994172:0:5864:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789583621.994409:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.994475:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.994485:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.994788:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.994820:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 14 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.994836:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5864:1876514332230784:0@lo:104: 00000100:00100000:1.0:1789583621.994898:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.997161:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583621.997703:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230784 00000100:00100000:3.0:1789583621.997712:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230784 00000100:00100000:3.0:1789583621.997969:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789583621.997979:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5864:x1876514332230784:12345-0@lo:104: 00010000:00010000:3.0:1789583621.998003:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583621.998243:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789583621.998250:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:5864:x1876514332230784:12345-0@lo:104: Request processed in 272us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583621.998257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789583621.998323:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583621.998330:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998357:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583621.998362:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998371:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583621.998377:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583621.998383:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583621.998447:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998454:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583621.998471:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998478:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641483400/0x6d3e73d72c6e2ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2cac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998506:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.998509:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583621.998511:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583621.998526:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332230912:0@lo:103: 00000100:00100000:1.0:1789583621.998564:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583621.998732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332230912 00000100:00100000:1.0:1789583621.998738:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332230912 00010000:00010000:1.0:1789583621.998761:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 15 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.998793:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583621.998801:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3307:x1876514332230912:12345-0@lo:103: 00010000:00010000:1.0:1789583621.998836:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583621.998842:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 15 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998853:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 15 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998871:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998879:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789583621.998896:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004723901s 00010000:00010000:1.0:1789583621.998900:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998908:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998915:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998922:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998927:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583621.998931:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998946:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998955:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.998965:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583621.999171:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3307:x1876514332230912:12345-0@lo:103: Request processed in 371us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583621.999179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583621.999234:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332230912:0@lo:103: 00010000:00010000:1.0:1789583621.999257:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b640030200/0x6d3e73d72c6e2cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ca5 expref: 14 pid: 5843 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583621.999268:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5864:1876514332230784:0@lo:104: 00010000:00010000:1.0:1789583621.999278:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.999285:0:5864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.999292:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583621.999298:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e2d5b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583622.006400:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:7645:x1876514332230528:12345-0@lo:253: Request processed in 46445us (46597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583622.006436:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789583622.006646:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:7645:1876514332230528:0@lo:253: 10000000:01000000:3.0:1789583622.006661:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789583622.006664:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789583622.006666:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789583622.006667:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789583622.006668:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789583622.006670:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789583622.006671:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789583622.006677:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789583622.006678:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789583622.006680:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789583622.006681:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789583622.006683:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789583622.006696:0:7645:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789583622.013929:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789583622.014320:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789583622.015919:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789583622.017285:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789583622.020298:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789583622.021556:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789583622.024664:0:7645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789583622.194769:0:7645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789583622.194777:0:7645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789583622.194832:0:7645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789583622.194882:0:7645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789583622.194900:0:7645:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789583622.194916:0:7645:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789583622.695462:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583623.719118:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583624.743952:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583625.767617:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583626.791000:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583626.791027:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332231040:0@lo:13: 00000100:00100000:1.0:1789583626.791091:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583626.791157:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231040 00000100:00100000:1.0:1789583626.791164:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231040 00000100:00100000:1.0:1789583626.791215:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789583626.791225:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332231040:12345-0@lo:13: 00002000:00000024:1.0:1789583626.791258:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583626.791305:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332231040:12345-0@lo:13: Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583626.791312:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789583626.791333:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789583626.791363:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97f480 x1876514332231040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583626.791381:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332231040:0@lo:13: 00010000:00010000:2.0:1789583626.800019:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583627.303648:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332231168:0@lo:400: 00000100:00100000:3.0:1789583627.303717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583627.303767:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332231680:0@lo:400: 00000100:00100000:3.0:1789583627.303794:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583627.304014:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789583627.304021:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332231296:0@lo:400: 00000100:00100000:3.0:1789583627.304045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583627.304190:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332231424:0@lo:400: 00000100:00100000:3.0:1789583627.304490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332231552:0@lo:400: 00000100:00100000:3.0:1789583627.304522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583627.304579:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231552 00000100:00100000:3.0:1789583627.304588:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231680 00000100:00100000:2.0:1789583627.304589:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231552 00000100:00100000:3.0:1789583627.304595:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231680 00000100:00100000:3.0:1789583627.304633:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231296 00000100:00100000:3.0:1789583627.304636:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231296 00000100:00100000:3.0:1789583627.304652:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789583627.304660:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332231680:12345-0@lo:400: 00000100:00100000:2.0:1789583627.304706:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583627.304714:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332231680:12345-0@lo:400: Request processed in 53us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583627.304723:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789583627.304741:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789583627.304748:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332231296:12345-0@lo:400: 00000100:00100000:2.0:1789583627.304790:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332231552:12345-0@lo:400: 00000100:00100000:3.0:1789583627.304791:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332231296:12345-0@lo:400: Request processed in 43us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583627.304863:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332231552:12345-0@lo:400: Request processed in 149us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583627.304871:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583627.304938:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231168 00000100:00100000:0.0:1789583627.304944:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231168 00000100:00100000:0.0:1789583627.305018:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789583627.305026:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3305:x1876514332231168:12345-0@lo:400: 00000100:00100000:0.0:1789583627.305062:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3305:x1876514332231168:12345-0@lo:400: Request processed in 38us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583627.305070:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789583627.305960:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789583627.306021:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583627.308008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789583627.308085:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dfb80 x1876514332231296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583627.308102:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332231296:0@lo:400: 00000100:00100000:2.0:1789583627.308115:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332231168:0@lo:400: 00010000:00080000:2.0:1789583627.308131:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dea00 x1876514332231680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583627.308141:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332231680:0@lo:400: 00000100:00100000:2.0:1789583627.308170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231424 00000100:00100000:2.0:1789583627.308176:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231424 00000100:00100000:2.0:1789583627.308240:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789583627.308250:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332231424:12345-0@lo:400: 00000100:00100000:2.0:1789583627.308302:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332231424:12345-0@lo:400: Request processed in 53us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583627.308309:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789583627.308355:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1ded80 x1876514332231424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583627.308365:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332231424:0@lo:400: 00000100:00080000:0.0:1789583627.311849:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789583627.311901:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dca80 x1876514332231552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583627.311929:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332231552:0@lo:400: 00010000:00010000:2.0:1789583627.820212:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583628.841468:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789583628.984509:0:8003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789583629.869953:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583630.887026:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583631.913538:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332231808:0@lo:13: 00000100:00100000:0.0:1789583631.913605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583631.913772:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231808 00000100:00100000:2.0:1789583631.913780:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231808 00000100:00100000:2.0:1789583631.913894:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789583631.913904:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332231808:12345-0@lo:13: 00002000:00000024:2.0:1789583631.913932:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583631.913978:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332231808:12345-0@lo:13: Request processed in 75us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.913985:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789583631.914032:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67badea00 x1876514332231808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583631.914050:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332231808:0@lo:13: 00000100:00080000:0.0:1789583631.914157:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789583631.915831:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789583631.915953:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789583631.915957:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b64a171800 from 30 10000000:01000000:0.0:1789583631.915962:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789583631.916001:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.916023:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.916033:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583631.916054:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332231936:0@lo:101: 00000100:00100000:0.0:1789583631.916100:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.916132:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf240 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.916455:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332231936 00000100:00100000:2.0:1789583631.916462:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332231936 00000100:00100000:2.0:1789583631.916509:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789583631.916518:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332231936:12345-0@lo:101: 00010000:00010000:2.0:1789583631.916530:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583631.916542:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d62 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583631.916564:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583631.916575:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583631.916597:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216ec00, rc 0) 00000100:00100000:2.0:1789583631.916638:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332231936:12345-0@lo:101: Request processed in 121us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.916644:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789583631.916844:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332231936:0@lo:101: 00010000:00010000:1.0:1789583631.916857:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.916867:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583631.916928:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232064:0@lo:501: 00000100:00100000:1.0:1789583631.916954:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.916975:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0900 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.917054:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232064 00000100:00100000:0.0:1789583631.917058:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232064 00000100:00100000:0.0:1789583631.917082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789583631.917088:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332232064:12345-0@lo:501: 00000100:00100000:0.0:1789583631.917406:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332232064:12345-0@lo:501: Request processed in 317us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.917413:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789583631.917446:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232064:0@lo:501: 00000100:00100000:0.0:1789583631.917480:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232192:0@lo:503: 00000100:00100000:0.0:1789583631.917513:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.917526:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.917537:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232192 00000100:00100000:0.0:1789583631.917541:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232192 00000100:00100000:0.0:1789583631.917559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789583631.917565:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332232192:12345-0@lo:503: 00000100:00100000:0.0:1789583631.918103:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332232192:12345-0@lo:503: Request processed in 536us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.918110:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789583631.918222:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232192:0@lo:503: 00000100:00100000:2.0:1789583631.918967:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8107:1876514332232320:0@lo:502: 00000100:00100000:2.0:1789583631.919026:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583631.919058:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.919413:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232320 00000100:00100000:0.0:1789583631.919418:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232320 00000100:00100000:0.0:1789583631.919455:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789583631.919463:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8107:x1876514332232320:12345-0@lo:502: 00000100:00100000:0.0:1789583631.919706:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8107:x1876514332232320:12345-0@lo:502: Request processed in 243us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.919714:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789583631.926165:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8107:1876514332232320:0@lo:502: 00000100:00100000:2.0:1789583631.926257:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8107:1876514332232448:0@lo:502: 00000100:00100000:2.0:1789583631.926330:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583631.926385:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.927979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232448 00000100:00100000:0.0:1789583631.927991:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232448 00000100:00100000:0.0:1789583631.928067:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789583631.928077:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8107:x1876514332232448:12345-0@lo:502: 00000100:00100000:0.0:1789583631.928335:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8107:x1876514332232448:12345-0@lo:502: Request processed in 259us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.928343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789583631.928768:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8107:1876514332232448:0@lo:502: 00000040:00080000:3.0:1789583631.928843:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789583631.929064:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789583631.929089:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789583631.929099:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.929111:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583631.929120:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789583631.929123:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789583631.929126:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789583631.929154:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.929162:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.929171:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583631.929188:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232576:0@lo:101: 00000100:00100000:1.0:1789583631.929224:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.929249:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.930380:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232576 00000100:00100000:0.0:1789583631.930389:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232576 00000100:00100000:0.0:1789583631.930443:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789583631.930460:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332232576:12345-0@lo:101: 00010000:00010000:0.0:1789583631.930473:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583631.930486:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d70 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.930507:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.930516:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.930524:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cae00, rc 0) 00000100:00100000:0.0:1789583631.930587:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332232576:12345-0@lo:101: Request processed in 129us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.930593:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789583631.930852:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232576:0@lo:101: 00010000:00010000:1.0:1789583631.930866:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.930876:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583631.930927:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232704:0@lo:501: 00000100:00100000:1.0:1789583631.930956:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.930986:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.931037:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232704 00000100:00100000:2.0:1789583631.931042:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232704 00000100:00100000:2.0:1789583631.931071:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789583631.931079:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332232704:12345-0@lo:501: 00000100:00100000:2.0:1789583631.931329:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332232704:12345-0@lo:501: Request processed in 250us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.931335:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789583631.931425:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232704:0@lo:501: 00000100:00100000:1.0:1789583631.931451:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232832:0@lo:503: 00000100:00100000:1.0:1789583631.931485:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.931508:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.931570:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232832 00000100:00100000:2.0:1789583631.931574:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232832 00000100:00100000:2.0:1789583631.931602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789583631.931608:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332232832:12345-0@lo:503: 00000100:00100000:2.0:1789583631.931909:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332232832:12345-0@lo:503: Request processed in 300us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.931916:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789583631.932035:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332232832:0@lo:503: 00000100:00100000:0.0:1789583631.932475:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8108:1876514332232960:0@lo:502: 00000100:00100000:0.0:1789583631.932511:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.932540:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.932593:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332232960 00000100:00100000:2.0:1789583631.932599:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332232960 00000100:00100000:2.0:1789583631.932630:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789583631.932637:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8108:x1876514332232960:12345-0@lo:502: 00000100:00100000:2.0:1789583631.932959:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8108:x1876514332232960:12345-0@lo:502: Request processed in 322us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.932967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789583631.933049:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8108:1876514332232960:0@lo:502: 00000020:01000000:0.0:1789583631.933072:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583631.933080:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583631.933082:0:8108:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789583631.933088:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789583631.933090:0:8108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789583631.933105:0:8108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8108:1876514332233088:0@lo:502: 00000100:00100000:0.0:1789583631.933137:0:8108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.933162:0:8108:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583631.933209:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233088 00000100:00100000:1.0:1789583631.933213:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233088 00000100:00100000:1.0:1789583631.933240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789583631.933246:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8108:x1876514332233088:12345-0@lo:502: 00000100:00100000:1.0:1789583631.933375:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8108:x1876514332233088:12345-0@lo:502: Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.933382:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789583631.933416:0:8108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8108:1876514332233088:0@lo:502: 00000020:01000000:3.0:1789583631.933435:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583631.933439:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583631.933440:0:8108:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789583631.933444:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789583631.934127:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789583631.934148:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789583631.934157:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.934180:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583631.934189:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789583631.934191:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b666645000 from 30 10000000:01000000:1.0:1789583631.934194:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789583631.934218:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.934236:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.934246:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583631.934260:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233216:0@lo:101: 00000100:00100000:1.0:1789583631.934294:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.934327:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.934394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233216 00000100:00100000:2.0:1789583631.934399:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233216 00000100:00100000:2.0:1789583631.934478:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789583631.934486:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332233216:12345-0@lo:101: 00010000:00010000:2.0:1789583631.934496:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583631.934506:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d7e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583631.934526:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583631.934536:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583631.934544:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f800, rc 0) 00000100:00100000:2.0:1789583631.934598:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332233216:12345-0@lo:101: Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.934604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789583631.934671:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233216:0@lo:101: 00010000:00010000:0.0:1789583631.934690:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.934698:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583631.934749:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233344:0@lo:501: 00000100:00100000:0.0:1789583631.934773:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.942416:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583631.953964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233344 00000100:00100000:1.0:1789583631.953977:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233344 00000100:00100000:1.0:1789583631.954052:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789583631.954062:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332233344:12345-0@lo:501: 00000100:00100000:1.0:1789583631.954391:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332233344:12345-0@lo:501: Request processed in 330us (19615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.954398:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789583631.954458:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233344:0@lo:501: 00000100:00100000:3.0:1789583631.954507:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233472:0@lo:503: 00000100:00100000:3.0:1789583631.954563:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.954600:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a062300 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.954826:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233472 00000100:00100000:2.0:1789583631.954832:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233472 00000100:00100000:2.0:1789583631.954869:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789583631.954876:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332233472:12345-0@lo:503: 00000100:00100000:2.0:1789583631.955085:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332233472:12345-0@lo:503: Request processed in 209us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.955092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789583631.955395:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233472:0@lo:503: 00000100:00100000:3.0:1789583631.958047:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8109:1876514332233600:0@lo:502: 00000100:00100000:3.0:1789583631.958126:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.958171:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.958282:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233600 00000100:00100000:2.0:1789583631.958290:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233600 00000100:00100000:2.0:1789583631.958339:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789583631.958357:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8109:x1876514332233600:12345-0@lo:502: 00000100:00100000:2.0:1789583631.958647:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8109:x1876514332233600:12345-0@lo:502: Request processed in 299us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.958654:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789583631.959011:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8109:1876514332233600:0@lo:502: 00000100:00100000:0.0:1789583631.959057:0:8109:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8109:1876514332233728:0@lo:502: 00000100:00100000:0.0:1789583631.959089:0:8109:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.959151:0:8109:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf480 going to sleep for 11 seconds 00000100:00100000:1.0:1789583631.959965:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233728 00000100:00100000:1.0:1789583631.959972:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233728 00000100:00100000:1.0:1789583631.960028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789583631.960044:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8109:x1876514332233728:12345-0@lo:502: 00000100:00100000:1.0:1789583631.960242:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8109:x1876514332233728:12345-0@lo:502: Request processed in 199us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.960249:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789583631.960400:0:8109:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8109:1876514332233728:0@lo:502: 00000040:00080000:0.0:1789583631.960424:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789583631.960575:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789583631.960594:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789583631.960604:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.960621:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583631.960630:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789583631.960632:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b666645000 from 5 10000000:01000000:3.0:1789583631.960635:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789583631.960659:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.960667:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.960675:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583631.960689:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233856:0@lo:101: 00000100:00100000:3.0:1789583631.960729:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.960760:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.960948:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233856 00000100:00100000:0.0:1789583631.960953:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233856 00000100:00100000:0.0:1789583631.960986:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789583631.960994:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332233856:12345-0@lo:101: 00010000:00010000:0.0:1789583631.961012:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583631.961024:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cb800/0x6d3e73d72c6e2d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.961044:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cb800/0x6d3e73d72c6e2d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d8c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.961054:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cb800/0x6d3e73d72c6e2d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d8c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.961070:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cb800, rc 0) 00000100:00100000:0.0:1789583631.961098:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332233856:12345-0@lo:101: Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.961104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789583631.961205:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233856:0@lo:101: 00010000:00010000:3.0:1789583631.961216:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.961225:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583631.961262:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233984:0@lo:256: 00000100:00100000:3.0:1789583631.961289:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.961318:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.961363:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332233984 00000100:00100000:0.0:1789583631.961366:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332233984 00000100:00100000:0.0:1789583631.961393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789583631.961400:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332233984:12345-0@lo:256: 20000000:01000000:0.0:1789583631.961411:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789583631.961426:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789583631.961429:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789583631.961488:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332233984:12345-0@lo:256: Request processed in 88us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.961494:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789583631.961551:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332233984:0@lo:256: 10000000:01000000:3.0:1789583631.961596:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789583631.961602:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.961609:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583631.961616:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789583631.961617:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789583631.961619:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789583631.961632:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.961638:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.961645:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583631.961657:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332234112:0@lo:101: 00000100:00100000:3.0:1789583631.961681:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.961701:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.961935:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234112 00000100:00100000:0.0:1789583631.961940:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234112 00000100:00100000:0.0:1789583631.961966:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789583631.961973:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332234112:12345-0@lo:101: 00010000:00010000:0.0:1789583631.961980:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583631.961987:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2d9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.962017:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.962026:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583631.962045:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752caa00, rc 0) 00000100:00100000:0.0:1789583631.962073:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332234112:12345-0@lo:101: Request processed in 100us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.962078:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789583631.962183:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332234112:0@lo:101: 00010000:00010000:3.0:1789583631.962193:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583631.962200:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583631.962246:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332234240:0@lo:501: 00000100:00100000:3.0:1789583631.962270:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.962294:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583631.962531:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234240 00000100:00100000:2.0:1789583631.962536:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234240 00000100:00100000:2.0:1789583631.962574:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789583631.962581:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332234240:12345-0@lo:501: 00000100:00100000:2.0:1789583631.963013:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332234240:12345-0@lo:501: Request processed in 424us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.963020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789583631.963134:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332234240:0@lo:501: 00000100:00100000:3.0:1789583631.963160:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332234368:0@lo:503: 00000100:00100000:3.0:1789583631.963194:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583631.963222:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.963344:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234368 00000100:00100000:0.0:1789583631.963357:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234368 00000100:00100000:0.0:1789583631.963389:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789583631.963396:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332234368:12345-0@lo:503: 00000100:00100000:0.0:1789583631.963675:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332234368:12345-0@lo:503: Request processed in 279us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.963681:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789583631.963843:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332234368:0@lo:503: 00000100:00100000:2.0:1789583631.964602:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8110:1876514332234496:0@lo:502: 00000100:00100000:2.0:1789583631.964647:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583631.964679:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.964797:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234496 00000100:00100000:0.0:1789583631.964802:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234496 00000100:00100000:0.0:1789583631.964854:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789583631.964862:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8110:x1876514332234496:12345-0@lo:502: 00000100:00100000:0.0:1789583631.965290:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8110:x1876514332234496:12345-0@lo:502: Request processed in 427us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.965297:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789583631.965376:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8110:1876514332234496:0@lo:502: 00000020:01000000:2.0:1789583631.965399:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789583631.965406:0:8110:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789583631.965412:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583631.965414:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789583631.965419:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789583631.965423:0:8110:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:2.0:1789583631.965448:0:8110:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789583631.965451:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789583631.965464:0:8110:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88b67c4bcd40) 00000020:00000080:2.0:1789583631.965481:0:8110:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789583631.965486:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789583631.965560:0:8110:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789583631.965565:0:8110:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789583631.965571:0:8110:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e2daf 00010000:00080000:2.0:1789583631.965599:0:8110:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b674e3f800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789583631.966414:0:8110:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789583631.966714:0:8110:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789583631.966738:0:8110:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789583631.967386:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789583631.967597:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789583631.967653:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789583631.967867:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789583631.972423:0:8111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789583631.972428:0:8111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789583631.974646:0:8110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789583631.974660:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789583631.974696:0:8110:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789583631.974730:0:8110:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e2db6 00000100:00080000:0.0:1789583631.974740:0:8110:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789583631.974751:0:8110:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b674e3f800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789583631.974787:0:8110:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67af5ca80 x1876514332234624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789583631.974870:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332234624:0@lo:8: 00000100:00100000:3.0:1789583631.974935:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789583631.975023:0:8110:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789583631.975071:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583631.975077:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583631.975079:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789583631.975082:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583631.975085:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583631.975087:0:8110:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789583631.975090:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789583631.975091:0:8110:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789583631.975116:0:8110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8110:1876514332234752:0@lo:502: 00000100:00100000:0.0:1789583631.975162:0:8110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583631.975197:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234752 00000100:00100000:0.0:1789583631.975202:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234752 00000100:00100000:0.0:1789583631.975243:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789583631.975251:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8110:x1876514332234752:12345-0@lo:502: 00000100:00100000:0.0:1789583631.975485:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8110:x1876514332234752:12345-0@lo:502: Request processed in 233us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583631.975493:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789583631.975532:0:8110:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf540 going to sleep for 11 seconds 00000100:00100000:0.0:1789583631.975551:0:8110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8110:1876514332234752:0@lo:502: 00000020:01000000:0.0:1789583631.975573:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583631.975585:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583631.975586:0:8110:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789583631.975590:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789583631.975891:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789583631.975911:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789583631.975920:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.975932:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583631.975942:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789583631.975944:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b648de8000 from 1 10000000:01000000:1.0:1789583631.975948:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789583631.975968:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.975975:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.975984:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583631.975996:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332235264:0@lo:101: 00000100:00100000:1.0:1789583631.976040:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.976058:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789583631.976071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332235008:0@lo:400: 00000100:00100000:1.0:1789583631.976104:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.976125:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789583631.976130:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332234880:0@lo:400: 00000100:00100000:1.0:1789583631.976149:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.976173:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332235136:0@lo:400: 00000100:00100000:1.0:1789583631.976196:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.976224:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235008 00000100:00100000:1.0:1789583631.976229:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235008 00000100:00100000:1.0:1789583631.976260:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234880 00000100:00100000:1.0:1789583631.976263:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234880 00000100:00100000:1.0:1789583631.976275:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235136 00000100:00100000:1.0:1789583631.976277:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235136 00000100:00100000:1.0:1789583631.976291:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789583631.976297:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332235008:12345-0@lo:400: 00000100:00100000:1.0:1789583631.976333:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332235008:12345-0@lo:400: Request processed in 36us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.976339:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789583631.976364:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583631.976370:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332234880:12345-0@lo:400: 00000100:00100000:1.0:1789583631.976395:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332234880:12345-0@lo:400: Request processed in 27us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.976401:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583631.976413:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583631.976420:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332235136:12345-0@lo:400: 00000100:00100000:1.0:1789583631.976447:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332235136:12345-0@lo:400: Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.976452:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789583631.976473:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583631.976483:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235264 00000100:00100000:1.0:1789583631.976487:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235264 00000100:00100000:1.0:1789583631.976507:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789583631.976514:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332235264:12345-0@lo:101: 00010000:00010000:1.0:1789583631.976521:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583631.976533:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2dbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.976553:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.976563:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.976571:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583631.976599:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332235264:12345-0@lo:101: Request processed in 86us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583631.976605:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789583631.976633:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332235264:0@lo:101: 00010000:00010000:1.0:1789583631.976645:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.976653:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583631.976692:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332235392:0@lo:501: 00000100:00100000:1.0:1789583631.976715:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583631.976727:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67c5c0600 going to sleep for 11 seconds 00010000:00080000:1.0:1789583631.976753:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97d500 x1876514332235136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583631.976776:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332235136:0@lo:400: 00010000:00080000:1.0:1789583631.976801:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97dc00 x1876514332234880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583631.976830:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332234880:0@lo:400: 00010000:00080000:1.0:1789583631.976841:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97ce00 x1876514332235008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583631.976849:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332235008:0@lo:400: 00000100:00100000:1.0:1789583631.976866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235392 00000100:00100000:1.0:1789583631.976869:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235392 00000100:00100000:1.0:1789583631.976885:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789583631.976890:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332235392:12345-0@lo:501: 00000100:00100000:1.0:1789583631.977083:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332235392:12345-0@lo:501: Request processed in 192us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583631.977090:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789583631.977116:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332235392:0@lo:501: 10000000:01000000:1.0:1789583631.977135:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789583631.977140:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583631.977148:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583631.977557:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332234624 00000100:00100000:2.0:1789583631.977561:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332234624 00000100:00100000:2.0:1789583631.977593:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789583631.977599:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876514332234624:12345-0@lo:8: 00010000:00080000:2.0:1789583631.977619:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:2.0:1789583631.977643:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e2dcb 00002000:00100000:2.0:1789583631.977654:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88b674e3d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789583631.977658:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789583631.977662:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789583631.977768:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789583631.977948:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789583631.977971:0:6704:0:(import.c:65:import_set_state_nolock()) ffff88b674e3e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583631.981367:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876514332234624:12345-0@lo:8: Request processed in 3749us (6414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583631.981381:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789583631.986255:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67af5ca80 x1876514332234624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789583641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583631.986270:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789583631.986279:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789583631.986288:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789583631.986293:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789583631.986296:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b674e3f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789583631.986364:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789583631.986370:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332234624:0@lo:8: 00000004:00080000:0.0:1789583631.986440:0:8111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789583631.986612:0:8111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 188970804897ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789583632.027109:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789583632.093220:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332235520:0@lo:13: 00000100:00100000:1.0:1789583632.093301:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583632.093383:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235520 00000100:00100000:1.0:1789583632.093390:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235520 00000100:00100000:1.0:1789583632.093437:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789583632.093446:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332235520:12345-0@lo:13: 00002000:00000024:1.0:1789583632.093478:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789583632.093520:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332235520:12345-0@lo:13: Request processed in 75us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583632.094034:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789583632.094061:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789583632.094104:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97c700 x1876514332235520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583648 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583632.094124:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332235520:0@lo:13: 00000004:00080000:1.0:1789583632.094144:0:8112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789583632.094166:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332235648:0@lo:7: 00000100:00100000:1.0:1789583632.094195:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583632.094213:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68540 going to sleep for 11 seconds 00000100:00100000:3.0:1789583632.094741:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235648 00000100:00100000:3.0:1789583632.094747:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235648 00000100:00100000:3.0:1789583632.094789:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789583632.094798:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8112:x1876514332235648:12345-0@lo:7: 00002000:00080000:3.0:1789583632.110070:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789583632.110078:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789583632.110174:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8112:x1876514332235648:12345-0@lo:7: Request processed in 15374us (15975us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583632.110184:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789583632.110422:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97c700 x1876514332235648/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789583648 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583632.110437:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332235648:0@lo:7: 00000004:00080000:1.0:1789583632.110451:0:8112:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789583632.110484:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332235776:0@lo:5: 00000100:00100000:1.0:1789583632.110514:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583632.110563:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68540 going to sleep for 11 seconds 00000100:00100000:2.0:1789583632.110857:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235776 00000100:00100000:2.0:1789583632.110865:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235776 00000100:00100000:2.0:1789583632.110909:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789583632.110918:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1876514332235776:12345-0@lo:5: 00002000:00080000:2.0:1789583632.110956:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789583632.110959:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789583632.111180:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8112:x1876514332235776:12345-0@lo:5: Request processed in 262us (664us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789583632.111187:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789583632.111384:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97c700 x1876514332235776/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789583648 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583632.111396:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332235776:0@lo:5: 00000004:00080000:3.0:1789583632.111405:0:8112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789583632.111430:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332235904:0@lo:700: 00000100:00100000:3.0:1789583632.111456:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583632.111520:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a062000 going to sleep for 11 seconds 00000100:00100000:0.0:1789583632.112308:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332235904 00000100:00100000:0.0:1789583632.112316:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332235904 00000100:00100000:0.0:1789583632.112368:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583632.112376:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8112:x1876514332235904:12345-0@lo:700: 00000100:00100000:0.0:1789583632.112409:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1876514332236032:0@lo:700: 00000100:00100000:0.0:1789583632.112443:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583632.112460:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6ad6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583632.112522:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236032 00000100:00100000:1.0:1789583632.112536:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236032 00000100:00100000:1.0:1789583632.112574:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789583632.112580:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1876514332236032:12345-0@lo:700: 40000000:02000000:0.0:1789583632.208869:0:5855:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789583632.221463:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1876514332236032:12345-0@lo:700: Request processed in 108876us (109013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583632.221476:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789583632.230235:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67af5ed80 x1876514332236032/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789583648 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583632.230252:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1876514332236032:0@lo:700: 40000000:02000000:3.0:1789583632.230265:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789583632.371225:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8112:x1876514332235904:12345-0@lo:700: Request processed in 258839us (259758us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583632.371239:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1789583632.371273:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789583632.371283:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1789583632.371324:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dd180 x1876514332235904/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789583648 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583632.371339:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332235904:0@lo:700: 00000004:02000040:3.0:1789583632.440710:0:8112:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789583632.456103:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332236160:0@lo:5: 00000100:00100000:3.0:1789583632.456176:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583632.456225:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a062480 going to sleep for 11 seconds 00000100:00100000:0.0:1789583632.458539:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236160 00000100:00100000:0.0:1789583632.458553:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236160 00000100:00100000:0.0:1789583632.458608:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789583632.458617:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8112:x1876514332236160:12345-0@lo:5: 00002000:00080000:1.0:1789583632.472420:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789583632.472440:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789583632.482497:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8112:x1876514332236160:12345-0@lo:5: Request processed in 23873us (26312us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789583632.482510:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789583632.482696:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dd180 x1876514332236160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789583648 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583632.482709:0:8112:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789583632.482722:0:8112:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88b64a1dd180 x1876514332236160/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789583648 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583632.482733:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1876514332236160:0@lo:5: 00000004:00080000:3.0:1789583632.482746:0:8112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789583632.941236:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583633.961542:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789583634.821161:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1789583634.988153:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583635.469160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583635.469202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339008 00000100:00100000:1.0:1789583635.469213:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339008 00000100:00100000:1.0:1789583635.469255:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 111 00000100:00100000:1.0:1789583635.469264:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2357:x1876514313339008:12345-192.168.203.46@tcp:250: 00010000:00080000:1.0:1789583635.469291:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from b5c501b0-a566-4083-bb80-bae594ae6290@192.168.203.46@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1789583635.469317:0:5843:0:(genops.c:1384:class_connect()) connect: client b5c501b0-a566-4083-bb80-bae594ae6290, cookie 0x6d3e73d72c6e2dd2 00000100:00080000:1.0:1789583635.469485:0:5843:0:(import.c:65:import_set_state_nolock()) ffff88b675258800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789583635.469555:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+5:2357:x1876514313339008:12345-192.168.203.46@tcp:250: Request processed in 291us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583635.469564:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 111 00000100:00100000:1.0:1789583635.481964:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583635.482049:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339136 00000100:00100000:2.0:1789583635.482059:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339136 00000100:00100000:2.0:1789583635.482111:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 112 00000100:00100000:2.0:1789583635.482122:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+5:5585:x1876514313339136:12345-192.168.203.46@tcp:101: 00010000:00010000:2.0:1789583635.482136:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583635.482154:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6299 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583635.482189:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583635.482200:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583635.482208:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f200, rc 0) 00000100:00100000:2.0:1789583635.482272:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+6:5585:x1876514313339136:12345-192.168.203.46@tcp:101: Request processed in 151us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583635.482279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 112 00000100:00100000:3.0:1789583635.496590:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583635.496648:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339264 00000100:00100000:0.0:1789583635.496658:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339264 00000100:00100000:0.0:1789583635.496719:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:0.0:1789583635.496730:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+6:5585:x1876514313339264:12345-192.168.203.46@tcp:501: 00000100:00100000:0.0:1789583635.497116:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+6:5585:x1876514313339264:12345-192.168.203.46@tcp:501: Request processed in 387us (531us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789583635.497126:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:3.0:1789583635.501193:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583635.501286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339392 00000100:00100000:0.0:1789583635.501296:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339392 00000100:00100000:0.0:1789583635.501409:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:0.0:1789583635.501422:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+6:5585:x1876514313339392:12345-192.168.203.46@tcp:101: 00010000:00010000:0.0:1789583635.501441:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583635.501747:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec62a0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583635.501776:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583635.501788:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583635.501797:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca000, rc 0) 00000100:00100000:0.0:1789583635.501879:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+7:5585:x1876514313339392:12345-192.168.203.46@tcp:101: Request processed in 460us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583635.501887:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:1.0:1789583635.505223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583635.505312:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339520 00000100:00100000:2.0:1789583635.505333:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339520 00000100:00100000:2.0:1789583635.505452:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:2.0:1789583635.505463:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+7:5585:x1876514313339520:12345-192.168.203.46@tcp:501: 00000100:00100000:2.0:1789583635.505708:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+8:5585:x1876514313339520:12345-192.168.203.46@tcp:501: Request processed in 246us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583635.505716:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:1.0:1789583635.508460:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583635.508533:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339648 00000100:00100000:0.0:1789583635.508579:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339648 00000100:00100000:0.0:1789583635.508642:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:0.0:1789583635.508652:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+8:5585:x1876514313339648:12345-192.168.203.46@tcp:503: 00000100:00100000:0.0:1789583635.509016:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+8:5585:x1876514313339648:12345-192.168.203.46@tcp:503: Request processed in 363us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583635.509033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:3.0:1789583635.517584:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583635.517687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339776 00000100:00100000:2.0:1789583635.517695:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339776 00000100:00100000:2.0:1789583635.517739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:2.0:1789583635.517749:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+8:5604:x1876514313339776:12345-192.168.203.46@tcp:502: 00000100:00100000:2.0:1789583635.518093:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+8:5604:x1876514313339776:12345-192.168.203.46@tcp:502: Request processed in 344us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583635.518101:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:0.0:1789583635.564387:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583635.564463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313339904 00000100:00100000:2.0:1789583635.564484:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313339904 00000100:00100000:2.0:1789583635.564534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:2.0:1789583635.564543:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+8:5604:x1876514313339904:12345-192.168.203.46@tcp:502: 00000100:00100000:2.0:1789583635.564826:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+8:5604:x1876514313339904:12345-192.168.203.46@tcp:502: Request processed in 262us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583635.564836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789583635.574094:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583635.574783:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340032 00000100:00100000:3.0:1789583635.574794:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340032 00000100:00100000:3.0:1789583635.575724:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:3.0:1789583635.575736:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+8:5585:x1876514313340032:12345-192.168.203.46@tcp:101: 00010000:00010000:3.0:1789583635.575753:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583635.575770:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a02000/0x6d3e73d72c6e2de7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec62ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583635.575798:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a02000/0x6d3e73d72c6e2de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62ca expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583635.576139:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a02000/0x6d3e73d72c6e2de7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62ca expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583635.576164:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02000, rc 0) 00000100:00100000:3.0:1789583635.576270:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:5585:x1876514313340032:12345-192.168.203.46@tcp:101: Request processed in 535us (2185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583635.576278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:1.0:1789583635.590164:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583635.590351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340160 00000100:00100000:0.0:1789583635.590361:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340160 00000100:00100000:0.0:1789583635.590798:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:0.0:1789583635.590840:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+9:5585:x1876514313340160:12345-192.168.203.46@tcp:256: 20000000:01000000:0.0:1789583635.590869:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789583635.590893:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789583635.590897:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789583635.590900:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789583635.590902:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789583635.594204:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+9:5585:x1876514313340160:12345-192.168.203.46@tcp:256: Request processed in 3387us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583635.594217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:2.0:1789583635.600300:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583635.600386:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340288 00000100:00100000:1.0:1789583635.600396:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340288 00000100:00100000:1.0:1789583635.600444:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:1.0:1789583635.600453:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+9:5585:x1876514313340288:12345-192.168.203.46@tcp:101: 00010000:00010000:1.0:1789583635.600470:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583635.600488:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec62d1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583635.600531:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583635.600542:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583635.600550:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb000, rc 0) 00000100:00100000:1.0:1789583635.600608:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5585:x1876514313340288:12345-192.168.203.46@tcp:101: Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583635.600615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:1.0:1789583635.610040:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583635.610113:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340416 00000100:00100000:2.0:1789583635.610123:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340416 00000100:00100000:2.0:1789583635.610175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:2.0:1789583635.610185:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:5585:x1876514313340416:12345-192.168.203.46@tcp:501: 00000100:00100000:2.0:1789583635.610534:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:5585:x1876514313340416:12345-192.168.203.46@tcp:501: Request processed in 349us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583635.610542:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:3.0:1789583635.623356:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583635.623440:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340544 00000100:00100000:0.0:1789583635.623449:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340544 00000100:00100000:0.0:1789583635.623502:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:0.0:1789583635.623511:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:5585:x1876514313340544:12345-192.168.203.46@tcp:503: 00000100:00100000:0.0:1789583635.623895:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:5585:x1876514313340544:12345-192.168.203.46@tcp:503: Request processed in 384us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583635.623904:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789583635.626683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583635.627134:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340672 00000100:00100000:1.0:1789583635.627144:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340672 00000100:00100000:1.0:1789583635.627200:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:1.0:1789583635.627210:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5606:x1876514313340672:12345-192.168.203.46@tcp:502: 00000100:00100000:1.0:1789583635.627471:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5606:x1876514313340672:12345-192.168.203.46@tcp:502: Request processed in 262us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583635.627479:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:1.0:1789583635.629672:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583635.629754:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340800 00000100:00100000:3.0:1789583635.629763:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340800 00000100:00100000:3.0:1789583635.629831:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00100000:3.0:1789583635.629841:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:5606:x1876514313340800:12345-192.168.203.46@tcp:502: 00000100:00100000:3.0:1789583635.630072:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:5606:x1876514313340800:12345-192.168.203.46@tcp:502: Request processed in 232us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583635.630079:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00100000:3.0:1789583635.632341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583635.632439:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313340928 00000100:00100000:1.0:1789583635.632448:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313340928 00000100:00100000:1.0:1789583635.632497:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789583635.632503:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1876514313340928:12345-192.168.203.46@tcp:38: 00010000:00080000:1.0:1789583635.632531:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1789583635.632578:0:5849:0:(genops.c:1384:class_connect()) connect: client 768b736a-7b4a-4614-9d07-b155a4183a8a, cookie 0x6d3e73d72c6e2df5 00000004:00100000:1.0:1789583635.632617:0:5849:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789583635.632623:0:5849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789583635.659725:0:5849:0:(import.c:65:import_set_state_nolock()) ffff88b674e39000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583635.659832:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2357:x1876514313340928:12345-192.168.203.46@tcp:38: Request processed in 27299us (27479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583635.659844:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00010000:00010000:1.0:1789583636.007020:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583636.666658:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583636.666697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583636.666783:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341056 00000100:00100000:2.0:1789583636.666793:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341056 00000100:00100000:2.0:1789583636.666882:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341184 00000100:00100000:2.0:1789583636.666886:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341184 00000100:00100000:2.0:1789583636.666904:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:2.0:1789583636.666912:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:0:x1876514313341056:12345-192.168.203.46@tcp:41: 00000004:00000024:2.0:1789583636.666951:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789583636.667003:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:0:x1876514313341056:12345-192.168.203.46@tcp:41: Request processed in 92us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583636.667011:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:2.0:1789583636.667028:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789583636.667034:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5585:x1876514313341184:12345-192.168.203.46@tcp:41: 00000004:00000024:2.0:1789583636.667044:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789583636.667061:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5585:x1876514313341184:12345-192.168.203.46@tcp:41: Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583636.667067:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00080000:1.0:1789583636.667132:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583636.671425:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583636.671554:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341312 00000100:00100000:2.0:1789583636.671564:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341312 00000100:00100000:2.0:1789583636.671617:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789583636.671626:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5585:x1876514313341312:12345-192.168.203.46@tcp:40: 00000100:00100000:2.0:1789583636.671711:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5585:x1876514313341312:12345-192.168.203.46@tcp:40: Request processed in 86us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583636.671735:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:3.0:1789583636.688058:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583636.688156:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341440 00000100:00100000:1.0:1789583636.688165:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341440 00000100:00100000:1.0:1789583636.688206:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789583636.688213:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876514313341440:12345-192.168.203.46@tcp:8: 00010000:00080000:1.0:1789583636.688250:0:6702:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1789583636.688283:0:6702:0:(genops.c:1384:class_connect()) connect: client 768b736a-7b4a-4614-9d07-b155a4183a8a, cookie 0x6d3e73d72c6e2dfc 00002000:00100000:1.0:1789583636.688293:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 768b736a-7b4a-4614-9d07-b155a4183a8a/ffff88b67525d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789583636.688324:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789583636.688655:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789583636.688687:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b67525b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789583636.689075:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2357:x1876514313341440:12345-192.168.203.46@tcp:8: Request processed in 859us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583636.689084:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:0.0:1789583636.705377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583636.705858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341824 00000100:00100000:2.0:1789583636.705867:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341824 00000100:00100000:2.0:1789583636.705929:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:2.0:1789583636.705938:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313341824:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789583636.705997:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313341824:12345-192.168.203.46@tcp:400: Request processed in 60us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583636.706005:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:0.0:1789583636.707851:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583636.708508:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583636.708556:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341696 00000100:00100000:0.0:1789583636.708570:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341696 00000100:00100000:0.0:1789583636.708612:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583636.708621:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5585:x1876514313341696:12345-192.168.203.46@tcp:33: 00000100:00100000:2.0:1789583636.709512:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341568 00000100:00100000:2.0:1789583636.709520:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341568 00000100:00100000:2.0:1789583636.709555:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789583636.709562:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1876514313341568:12345-192.168.203.46@tcp:8: 00010000:00080000:2.0:1789583636.709585:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1789583636.709615:0:6705:0:(genops.c:1384:class_connect()) connect: client 768b736a-7b4a-4614-9d07-b155a4183a8a, cookie 0x6d3e73d72c6e2e03 00002000:00100000:2.0:1789583636.709635:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 768b736a-7b4a-4614-9d07-b155a4183a8a/ffff88b674e3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789583636.709660:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789583636.710006:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789583636.710035:0:6705:0:(import.c:65:import_set_state_nolock()) ffff88b674e3e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583636.710092:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2357:x1876514313341568:12345-192.168.203.46@tcp:8: Request processed in 529us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583636.710100:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000004:00080000:0.0:1789583636.734590:0:5851:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25907us 00000004:00200000:1.0:1789583636.752461:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789583636.752569:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5585:x1876514313341696:12345-192.168.203.46@tcp:33: Request processed in 43944us (44057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583636.752584:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583636.980143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583636.980253:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313341952 00000100:00100000:3.0:1789583636.980262:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313341952 00000100:00100000:3.0:1789583636.980334:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789583636.980344:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5623:x1876514313341952:12345-192.168.203.46@tcp:101: 00010000:00010000:3.0:1789583636.980364:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583636.980436:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02600/0x6d3e73d72c6e2e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec62fb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583636.980499:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2e11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583636.980532:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583636.980548:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583636.980599:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789583636.980603:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583636.980620:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583636.980644:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02600/0x6d3e73d72c6e2e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62fb expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583636.980661:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62fb expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583636.980669:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64336a600) 00010000:00010000:3.0:1789583636.980672:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583636.980675:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03e00, rc 0) 00000100:00100000:3.0:1789583636.980731:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:5623:x1876514313341952:12345-192.168.203.46@tcp:101: Request processed in 389us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583636.980738:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00010000:00010000:1.0:1789583637.031092:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583637.031115:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583637.031140:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332236288:0@lo:13: 00000100:00100000:3.0:1789583637.031222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583637.031340:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236288 00000100:00100000:3.0:1789583637.031347:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236288 00000100:00080000:1.0:1789583637.031413:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583637.031443:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583637.031454:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332236288:12345-0@lo:13: 00002000:00000024:3.0:1789583637.031476:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583637.031527:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332236288:12345-0@lo:13: Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583637.031534:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789583637.031580:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67badca80 x1876514332236288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583637.031599:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332236288:0@lo:13: 00000100:00100000:0.0:1789583637.031751:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789583637.031775:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67bade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332236416:0@lo:400: 00000100:00100000:0.0:1789583637.031849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583637.031883:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332236800:0@lo:400: 00000100:00100000:0.0:1789583637.031912:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583637.031933:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789583637.031941:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332236928:0@lo:400: 00000100:00100000:0.0:1789583637.031970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583637.031999:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236800 00000100:00100000:0.0:1789583637.032004:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236800 00000100:00100000:0.0:1789583637.032058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583637.032067:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332236800:12345-0@lo:400: 00000100:00100000:0.0:1789583637.032103:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332236800:12345-0@lo:400: Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583637.032110:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583637.032131:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236928 00000100:00100000:0.0:1789583637.032134:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236928 00000100:00100000:0.0:1789583637.032165:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789583637.032171:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332236928:12345-0@lo:400: 00000100:00100000:0.0:1789583637.032199:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332236928:12345-0@lo:400: Request processed in 30us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583637.032211:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789583637.032644:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332236672:0@lo:400: 00000100:00100000:1.0:1789583637.032678:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583637.032702:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789583637.032708:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332236544:0@lo:400: 00000100:00100000:1.0:1789583637.032728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789583637.038847:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789583637.038857:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583637.038895:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236416 00000100:00100000:0.0:1789583637.038906:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236416 00000100:00100000:2.0:1789583637.040932:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236672 00000100:00100000:2.0:1789583637.040942:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236672 00000100:00100000:0.0:1789583637.041105:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789583637.041115:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332236416:12345-0@lo:400: 00000100:00100000:0.0:1789583637.041195:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332236416:12345-0@lo:400: Request processed in 82us (9346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583637.041202:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789583637.041235:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583637.041341:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332236544 00000100:00100000:2.0:1789583637.041346:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332236544 00000100:00100000:2.0:1789583637.041372:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789583637.041378:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332236672:12345-0@lo:400: 00000100:00100000:2.0:1789583637.041428:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332236672:12345-0@lo:400: Request processed in 50us (8750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583637.041435:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789583637.041451:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789583637.041457:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332236544:12345-0@lo:400: 00000100:00100000:2.0:1789583637.041486:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332236544:12345-0@lo:400: Request processed in 30us (8758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583637.041492:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789583637.041623:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67baddc00 x1876514332236928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583637.041635:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789583637.041648:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332236928:0@lo:400: 00000100:00100000:3.0:1789583637.041663:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332236800:0@lo:400: 00000100:00100000:3.0:1789583637.041672:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67bade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332236416:0@lo:400: 00000100:00100000:0.0:1789583637.042259:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332236544:0@lo:400: 00000100:00100000:0.0:1789583637.042272:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332236672:0@lo:400: 00000001:00100000:0.0:1789583637.144180:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000100:00100000:0.0:1789583637.544168:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583637.544193:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332237056:0@lo:13: 00000100:00100000:0.0:1789583637.544284:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583637.544471:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237056 00000100:00100000:2.0:1789583637.544480:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237056 00000100:00100000:2.0:1789583637.544521:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583637.544529:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332237056:12345-0@lo:13: 00002000:00000024:2.0:1789583637.544549:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583637.544598:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332237056:12345-0@lo:13: Request processed in 70us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583637.544604:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789583637.544735:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dd180 x1876514332237056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583653 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583637.544752:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332237056:0@lo:13: 00010000:00010000:0.0:1789583638.055566:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583639.079066:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583639.519044:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583639.519773:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342080 00000100:00100000:2.0:1789583639.519787:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342080 00000100:00100000:2.0:1789583639.520023:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789583639.520044:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:5676:x1876514313342080:12345-192.168.203.46@tcp:41: 00000004:00000024:2.0:1789583639.520095:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789583639.520224:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:5676:x1876514313342080:12345-192.168.203.46@tcp:41: Request processed in 191us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583639.520232:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00080000:0.0:1789583639.520670:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583639.527700:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583639.529752:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342208 00000100:00100000:1.0:1789583639.529768:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342208 00000100:00100000:1.0:1789583639.529902:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789583639.529914:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:768b736a-7b4a-4614-9d07-b155a4183a8a+5:5676:x1876514313342208:12345-192.168.203.46@tcp:13: 00002000:00000024:1.0:1789583639.529951:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583639.530030:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bade680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:768b736a-7b4a-4614-9d07-b155a4183a8a+5:5676:x1876514313342208:12345-192.168.203.46@tcp:13: Request processed in 119us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583639.530038:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00080000:0.0:1789583639.530656:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583639.534279:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583639.534372:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342336 00000100:00100000:2.0:1789583639.534382:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342336 00000100:00100000:2.0:1789583639.534450:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789583639.534459:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5676:x1876514313342336:12345-192.168.203.46@tcp:13: 00000100:00080000:0.0:1789583639.534624:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789583639.534657:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583639.534724:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:768b736a-7b4a-4614-9d07-b155a4183a8a+6:5676:x1876514313342336:12345-192.168.203.46@tcp:13: Request processed in 266us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583639.534731:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00010000:00010000:2.0:1789583640.103165:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583641.127393:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583641.192659:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000001:00100000:3.0:1789583641.268589:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00010000:00010000:1.0:1789583642.151049:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583642.151191:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332237312:0@lo:400: 00000100:00100000:2.0:1789583642.151271:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583642.151461:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237312 00000100:00100000:0.0:1789583642.151476:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237312 00000100:00100000:1.0:1789583642.151485:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332237184:0@lo:13: 00000100:00100000:2.0:1789583642.151516:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789583642.151527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789583642.151529:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332237440:0@lo:400: 00000100:00100000:1.0:1789583642.151530:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583642.151541:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332237312:12345-0@lo:400: 00000100:00100000:2.0:1789583642.151572:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583642.151604:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237184 00000100:00100000:1.0:1789583642.151609:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237184 00000100:00100000:1.0:1789583642.151649:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583642.151660:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332237184:12345-0@lo:13: 00002000:00000024:1.0:1789583642.151689:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583642.151706:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237440 00000100:00100000:3.0:1789583642.151711:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237440 00000100:00100000:3.0:1789583642.151749:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789583642.151757:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332237440:12345-0@lo:400: 00000100:00100000:2.0:1789583642.151849:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332237312:0@lo:400: 00000100:00100000:2.0:1789583642.151870:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332237824:0@lo:400: 00000100:00100000:2.0:1789583642.151897:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583642.152160:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237824 00000100:00100000:2.0:1789583642.152164:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237824 00000100:00100000:2.0:1789583642.152345:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789583642.152353:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332237824:12345-0@lo:400: 00000100:00100000:2.0:1789583642.152439:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332237824:12345-0@lo:400: Request processed in 88us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583642.152446:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789583642.152481:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4aad80 x1876514332237824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583658 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583642.152512:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332237824:0@lo:400: 00000100:00080000:2.0:1789583642.152698:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583642.152703:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583642.152727:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332237568:0@lo:400: 00000100:00100000:2.0:1789583642.152755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583642.152786:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583642.152793:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332237696:0@lo:400: 00000100:00100000:2.0:1789583642.152838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583642.152860:0:5848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789583642.152868:0:5848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789583642.152997:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237568 00000100:00100000:2.0:1789583642.153002:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237568 00000100:00100000:2.0:1789583642.153025:0:5848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789583642.153030:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237696 00000100:00100000:2.0:1789583642.153033:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237696 00000100:00100000:2.0:1789583642.153045:0:5848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789583642.153052:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789583642.153058:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332237568:12345-0@lo:400: 00000100:00100000:2.0:1789583642.153092:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332237568:12345-0@lo:400: Request processed in 34us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583642.153098:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789583642.153111:0:5848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789583642.153117:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789583642.153122:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332237696:12345-0@lo:400: 00000100:00100000:2.0:1789583642.153148:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332237696:12345-0@lo:400: Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583642.153153:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789583642.153173:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583642.154427:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332237696:0@lo:400: 00000100:00100000:2.0:1789583642.154443:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332237568:0@lo:400: 00000100:00100000:0.0:1789583642.155815:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332237312:12345-0@lo:400: Request processed in 4260us (4525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583642.155829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789583642.163199:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332237440:0@lo:400: 00000100:00100000:1.0:1789583642.165543:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332237184:12345-0@lo:13: Request processed in 13877us (14008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583642.165559:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789583642.165640:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67badf100 x1876514332237184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583642.165663:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332237184:0@lo:13: 00000100:00100000:2.0:1789583642.166299:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583642.166327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583642.166358:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583642.166383:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583642.166404:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342848 00000100:00100000:2.0:1789583642.166410:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342848 00000100:00100000:2.0:1789583642.166453:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342720 00000100:00100000:2.0:1789583642.166457:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342720 00000100:00100000:2.0:1789583642.166476:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:2.0:1789583642.166485:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313342848:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789583642.166547:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313342848:12345-192.168.203.46@tcp:400: Request processed in 62us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583642.166554:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:2.0:1789583642.166569:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789583642.166576:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313342720:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789583642.166600:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313342720:12345-192.168.203.46@tcp:400: Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583642.166607:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00080000:2.0:1789583642.166621:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583642.166625:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583642.166636:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342592 00000100:00100000:2.0:1789583642.166640:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342592 00000100:00100000:2.0:1789583642.166669:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:2.0:1789583642.166675:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313342592:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789583642.166713:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313342592:12345-192.168.203.46@tcp:400: Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583642.166720:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00080000:2.0:1789583642.166735:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583642.166832:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342464 00000100:00100000:0.0:1789583642.166837:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342464 00000100:00100000:0.0:1789583642.166864:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:0.0:1789583642.166871:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313342464:12345-192.168.203.46@tcp:400: 00000100:00100000:0.0:1789583642.166899:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313342464:12345-192.168.203.46@tcp:400: Request processed in 29us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583642.166905:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:3.0:1789583642.167520:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332237440:12345-0@lo:400: Request processed in 15761us (15945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583642.167529:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789583642.663253:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332237952:0@lo:13: 00000100:00100000:2.0:1789583642.663331:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583642.663492:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332237952 00000100:00100000:1.0:1789583642.663509:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332237952 00000100:00100000:1.0:1789583642.663574:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583642.663585:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332237952:12345-0@lo:13: 00002000:00000024:1.0:1789583642.663621:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583642.663676:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332237952:12345-0@lo:13: Request processed in 93us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583642.663682:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789583642.664126:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4ab480 x1876514332237952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583658 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583642.664143:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332237952:0@lo:13: 00000001:02000400:0.0:1789583642.910201:0:8317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789583643.179192:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583644.199025:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583645.228207:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583646.267476:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583647.271044:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332238336:0@lo:400: 00000100:00100000:3.0:1789583647.271116:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583647.271167:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583647.271183:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332238464:0@lo:400: 00000100:00100000:3.0:1789583647.271211:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.271392:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332238080:0@lo:400: 00000100:00100000:2.0:1789583647.271427:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.271460:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332238592:0@lo:400: 00000100:00100000:2.0:1789583647.271482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.271501:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789583647.271507:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332238208:0@lo:400: 00000100:00100000:2.0:1789583647.271528:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.271545:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332238720:0@lo:400: 00000100:00100000:2.0:1789583647.271565:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.271594:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238336 00000100:00100000:2.0:1789583647.271601:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238336 00000100:00100000:2.0:1789583647.271744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238592 00000100:00100000:2.0:1789583647.271748:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238592 00000100:00100000:2.0:1789583647.271766:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238208 00000100:00100000:2.0:1789583647.271769:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238208 00000100:00100000:2.0:1789583647.271792:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789583647.271799:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332238336:12345-0@lo:400: 00000100:00100000:2.0:1789583647.271874:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332238336:12345-0@lo:400: Request processed in 75us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.271881:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789583647.271902:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789583647.271908:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332238592:12345-0@lo:400: 00000100:00100000:2.0:1789583647.271939:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332238592:12345-0@lo:400: Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.271945:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789583647.271956:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789583647.271962:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332238208:12345-0@lo:400: 00000100:00100000:2.0:1789583647.271988:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332238208:12345-0@lo:400: Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.271994:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789583647.272011:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238464 00000100:00100000:2.0:1789583647.272014:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238464 00000100:00100000:2.0:1789583647.272036:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238720 00000100:00100000:2.0:1789583647.272039:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238720 00000100:00100000:2.0:1789583647.272051:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583647.272057:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332238464:12345-0@lo:400: 00000100:00100000:2.0:1789583647.272085:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332238464:12345-0@lo:400: Request processed in 29us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.272091:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583647.272101:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789583647.272106:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332238720:12345-0@lo:400: 00000100:00100000:2.0:1789583647.272128:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332238720:12345-0@lo:400: Request processed in 22us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.272139:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789583647.272178:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583647.272182:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583647.272184:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583647.272216:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332238208:0@lo:400: 00010000:00080000:2.0:1789583647.272230:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4a8700 x1876514332238720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583647.272254:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332238720:0@lo:400: 00000100:00100000:2.0:1789583647.272265:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332238592:0@lo:400: 00010000:00080000:2.0:1789583647.272297:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4a8e00 x1876514332238464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583647.272306:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332238464:0@lo:400: 00000100:00100000:2.0:1789583647.272315:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332238336:0@lo:400: 00000100:00100000:3.0:1789583647.272440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238080 00000100:00100000:3.0:1789583647.272445:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238080 00000100:00100000:3.0:1789583647.272482:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789583647.272490:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332238080:12345-0@lo:400: 00000100:00100000:3.0:1789583647.272530:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332238080:12345-0@lo:400: Request processed in 41us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583647.272536:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789583647.272706:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332238080:0@lo:400: 00000100:00100000:2.0:1789583647.276884:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789583647.276907:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332238848:0@lo:13: 00000100:00100000:2.0:1789583647.276969:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.277017:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332238848 00000100:00100000:2.0:1789583647.277025:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332238848 00000100:00100000:2.0:1789583647.277069:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789583647.277078:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332238848:12345-0@lo:13: 00002000:00000024:2.0:1789583647.277116:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583647.277156:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332238848:12345-0@lo:13: Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.277173:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789583647.277210:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67badf100 x1876514332238848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583647.277228:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332238848:0@lo:13: 00010000:00010000:1.0:1789583647.278898:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583647.285105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583647.285148:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583647.285179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583647.285206:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583647.285233:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343232 00000100:00100000:3.0:1789583647.285252:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343232 00000100:00100000:3.0:1789583647.285309:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343360 00000100:00100000:3.0:1789583647.285312:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343360 00000100:00100000:3.0:1789583647.285330:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:3.0:1789583647.285340:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313343232:12345-192.168.203.46@tcp:400: 00000100:00100000:3.0:1789583647.285409:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313343232:12345-192.168.203.46@tcp:400: Request processed in 71us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583647.285417:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:3.0:1789583647.285433:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:3.0:1789583647.285440:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313343360:12345-192.168.203.46@tcp:400: 00000100:00100000:3.0:1789583647.285463:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313343360:12345-192.168.203.46@tcp:400: Request processed in 24us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583647.285469:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00080000:3.0:1789583647.285589:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583647.285594:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583647.285607:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343104 00000100:00100000:3.0:1789583647.285610:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343104 00000100:00100000:3.0:1789583647.285643:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789583647.285650:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313343104:12345-192.168.203.46@tcp:400: 00000100:00100000:3.0:1789583647.285684:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313343104:12345-192.168.203.46@tcp:400: Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583647.285690:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:2.0:1789583647.285834:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313342976 00000100:00100000:2.0:1789583647.285839:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313342976 00000100:00100000:2.0:1789583647.285877:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:2.0:1789583647.285885:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2360:x1876514313342976:12345-192.168.203.46@tcp:400: 00000100:00100000:2.0:1789583647.285916:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2360:x1876514313342976:12345-192.168.203.46@tcp:400: Request processed in 32us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.285922:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00080000:3.0:1789583647.285983:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789583647.558245:0:8465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd41477650 20000000:00000080:2.0:1789583647.558263:0:8465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b541c66800 uarg=0000000000000000 20000000:01000000:2.0:1789583647.558324:0:8465:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789583647.558327:0:8465:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789583647.558330:0:8465:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789583647.558334:0:8465:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789583647.558340:0:8465:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789583647.558354:0:8465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789583647.558356:0:8465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789583647.558577:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789583647.558579:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789583647.564387:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789583647.565291:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789583647.565347:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789583647.565398:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789583647.565413:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789583647.565416:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789583647.566851:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789583647.567366:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789583647.567425:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789583647.567463:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1789583647.567476:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789583647.567478:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789583647.568351:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789583647.568746:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789583647.568797:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789583647.568993:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789583647.569009:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789583647.569011:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789583647.569790:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789583647.570500:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789583647.570565:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789583647.570603:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1789583647.570618:0:8465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789583647.570638:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570656:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570664:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570671:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570677:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570683:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570689:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570696:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570705:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570712:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570740:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570781:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.570796:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 9 pid: 5841 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583647.571151:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332238976:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583647.571372:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571382:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 9 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571391:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239104:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583647.571420:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571428:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571438:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239232:0@lo:104: 00000100:00100000:3.0:1789583647.571474:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789583647.571513:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571533:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571542:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239360:0@lo:104: 00000100:00100000:3.0:1789583647.571569:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789583647.571600:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571608:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 18 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571615:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239488:0@lo:104: 00010000:00010000:3.0:1789583647.571637:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571643:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 18 pid: 5841 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571649:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239616:0@lo:104: 00010000:00010000:3.0:1789583647.571666:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571673:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 18 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571680:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239744:0@lo:104: 00010000:00010000:3.0:1789583647.571700:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571718:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571737:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239872:0@lo:104: 00010000:00010000:3.0:1789583647.571763:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.571771:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583647.571779:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332240000:0@lo:104: 00000100:00100000:3.0:1789583647.571796:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583647.572228:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789583647.572258:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.572279:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.572287:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.572296:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.572305:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.572314:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332239232 00000100:00100000:0.0:1789583647.572320:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332239232 00000100:00100000:0.0:1789583647.572356:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332239360 00000100:00100000:0.0:1789583647.572359:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332239360 00000100:00100000:0.0:1789583647.572371:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332239488 00000100:00100000:0.0:1789583647.572373:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332239488 00000100:00100000:0.0:1789583647.572383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332239616 00000100:00100000:0.0:1789583647.572385:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332239616 00000100:00100000:0.0:1789583647.572393:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332239744 00000100:00100000:0.0:1789583647.572394:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332239744 00000100:00100000:0.0:1789583647.572402:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332239872 00000100:00100000:0.0:1789583647.572404:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332239872 00000100:00100000:0.0:1789583647.572412:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240000 00000100:00100000:0.0:1789583647.572414:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240000 00000100:00100000:0.0:1789583647.572427:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583647.572436:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:8465:x1876514332239232:12345-0@lo:104: 00010000:00010000:0.0:1789583647.572449:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.572509:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789583647.572515:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+9:8465:x1876514332239232:12345-0@lo:104: Request processed in 81us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.572522:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583647.572621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789583647.572629:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+8:8465:x1876514332239360:12345-0@lo:104: 00010000:00010000:0.0:1789583647.572638:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.572686:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789583647.572692:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648c0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+8:8465:x1876514332239360:12345-0@lo:104: Request processed in 64us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.572698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789583647.572731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789583647.572738:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+7:8465:x1876514332239488:12345-0@lo:104: 00010000:00010000:0.0:1789583647.572745:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.572779:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789583647.572784:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+7:8465:x1876514332239488:12345-0@lo:104: Request processed in 48us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.572790:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789583647.572825:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789583647.572962:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+6:8465:x1876514332239616:12345-0@lo:104: 00010000:00010000:0.0:1789583647.572971:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573001:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789583647.573006:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+6:8465:x1876514332239616:12345-0@lo:104: Request processed in 175us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.573012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789583647.573026:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583647.573032:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:8465:x1876514332239744:12345-0@lo:104: 00010000:00010000:0.0:1789583647.573040:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573077:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789583647.573083:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:8465:x1876514332239744:12345-0@lo:104: Request processed in 51us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.573089:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583647.573101:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789583647.573106:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:8465:x1876514332239872:12345-0@lo:104: 00010000:00010000:0.0:1789583647.573113:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573141:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789583647.573145:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:8465:x1876514332239872:12345-0@lo:104: Request processed in 40us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.573151:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789583647.573164:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789583647.573170:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:8465:x1876514332240000:12345-0@lo:104: 00010000:00010000:0.0:1789583647.573177:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573203:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789583647.573208:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:8465:x1876514332240000:12345-0@lo:104: Request processed in 39us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.573214:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789583647.573245:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789583647.573252:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573259:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573270:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573279:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583647.573286:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.573292:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.573321:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573328:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.573348:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573355:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfa200/0x6d3e73d72c6e2dbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2dc4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573368:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789583647.573372:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573377:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03000 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573381:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573387:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583647.573405:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.573410:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.573424:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573430:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.573444:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573451:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b645a03000/0x6d3e73d72c6e2d9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2da1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573461:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789583647.573463:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573468:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573471:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573478:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583647.573484:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.573489:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.573511:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573517:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.573523:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573529:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e2d7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573539:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789583647.573542:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573548:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573551:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573557:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583647.573564:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.573569:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.573581:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573586:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.573591:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573607:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e2d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d77 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573618:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789583647.573621:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573627:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573631:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573638:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583647.573645:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.573650:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.573663:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573669:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.573673:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573680:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752cb200/0x6d3e73d72c6e2d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d69 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573688:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789583647.573697:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573703:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573706:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573712:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583647.573718:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.573733:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.573747:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573753:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.573758:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573764:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e2d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d3f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573772:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583647.573775:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573781:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583647.573784:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.573801:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.574055:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583647.574291:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239232:0@lo:104: 00000100:00100000:3.0:1789583647.574304:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239360:0@lo:104: 10000000:00010000:0.0:1789583647.574420:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583647.574426:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583647.574453:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.574459:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583647.574464:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.574470:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752cb600/0x6d3e73d72c6e2d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d15 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.574484:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583647.574485:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583647.574487:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583647.574494:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583647.574506:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332240128:0@lo:103: 00000100:00100000:0.0:1789583647.574551:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.574594:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332240640:0@lo:103: 00000100:00100000:0.0:1789583647.574616:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.574635:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583647.574641:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332240512:0@lo:103: 00000100:00100000:0.0:1789583647.574662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.574705:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240256:0@lo:103: 00000100:00100000:0.0:1789583647.574741:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.574753:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240768:0@lo:103: 00000100:00100000:0.0:1789583647.574771:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.574782:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789583647.574786:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240384:0@lo:103: 00000100:00100000:3.0:1789583647.575063:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239488:0@lo:104: 00000100:00100000:3.0:1789583647.575073:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239616:0@lo:104: 00000100:00100000:3.0:1789583647.575081:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239744:0@lo:104: 00000100:00100000:3.0:1789583647.575090:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239872:0@lo:104: 00000100:00100000:3.0:1789583647.575098:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332240000:0@lo:104: 00000100:00100000:3.0:1789583647.575110:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332238976:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583647.575118:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1876514332239104:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583647.575155:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575247:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.575272:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240896:0@lo:103: 00000100:00100000:0.0:1789583647.575294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583647.575320:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240128 00000100:00100000:0.0:1789583647.575326:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240128 00010000:00010000:0.0:1789583647.575352:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 19 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575369:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240640 00000100:00100000:0.0:1789583647.575371:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240640 00010000:00010000:0.0:1789583647.575380:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 20 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575388:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240512 00000100:00100000:0.0:1789583647.575390:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240512 00010000:00010000:0.0:1789583647.575398:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 21 pid: 5841 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575407:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240256 00000100:00100000:0.0:1789583647.575409:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240256 00010000:00010000:0.0:1789583647.575418:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 22 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575427:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240768 00000100:00100000:0.0:1789583647.575435:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240768 00010000:00010000:0.0:1789583647.575447:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 23 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575458:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240384 00000100:00100000:0.0:1789583647.575460:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240384 00010000:00010000:0.0:1789583647.575471:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 24 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575480:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332240896 00000100:00100000:0.0:1789583647.575482:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332240896 00010000:00010000:0.0:1789583647.575491:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 25 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.575502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583647.575509:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+25:3308:x1876514332240128:12345-0@lo:103: 00010000:00010000:0.0:1789583647.575520:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583647.575525:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 25 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575534:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 25 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575547:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfae00/0x6d3e73d72c6e2dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2dbd expref: 25 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575560:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583647.575595:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+24:3308:x1876514332240128:12345-0@lo:103: Request processed in 86us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.575601:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583647.575615:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789583647.575627:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+23:3308:x1876514332240640:12345-0@lo:103: 00010000:00010000:0.0:1789583647.575635:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583647.575639:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 23 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575647:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 23 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575657:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2d69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d62 expref: 23 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575666:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583647.575691:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+22:3308:x1876514332240640:12345-0@lo:103: Request processed in 64us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.575697:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789583647.575709:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789583647.575715:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3308:x1876514332240512:12345-0@lo:103: 00010000:00010000:0.0:1789583647.575731:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583647.575736:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 21 pid: 5841 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575745:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 21 pid: 5841 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575754:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d70 expref: 21 pid: 5841 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583647.575762:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583647.575784:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3308:x1876514332240512:12345-0@lo:103: Request processed in 69us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583647.575799:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583647.576020:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583647.576032:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3305:x1876514332240256:12345-0@lo:103: 00010000:00010000:1.0:1789583647.576041:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583647.576047:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 20 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576056:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 20 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576067:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2da1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d9a expref: 20 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576075:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583647.576109:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332240256:12345-0@lo:103: Request processed in 82us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583647.576123:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583647.576152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789583647.576158:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:3305:x1876514332240768:12345-0@lo:103: 00010000:00010000:1.0:1789583647.576164:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583647.576168:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576176:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576185:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d38 expref: 18 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576193:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583647.576213:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:3305:x1876514332240768:12345-0@lo:103: Request processed in 56us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583647.576218:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789583647.576229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789583647.576245:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3305:x1876514332240384:12345-0@lo:103: 00010000:00010000:1.0:1789583647.576252:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583647.576256:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 16 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576263:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 16 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576272:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2d85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d7e expref: 16 pid: 5842 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576291:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583647.576315:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3305:x1876514332240384:12345-0@lo:103: Request processed in 80us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583647.576321:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789583647.576333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789583647.576340:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:3305:x1876514332240896:12345-0@lo:103: 00010000:00010000:1.0:1789583647.576346:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583647.576352:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 14 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576359:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 14 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576368:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a03c00/0x6d3e73d72c6e2d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d0e expref: 14 pid: 5843 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583647.576376:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583647.576397:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:3305:x1876514332240896:12345-0@lo:103: Request processed in 59us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583647.576403:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789583647.576549:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332240512:0@lo:103: 00000100:00100000:0.0:1789583647.576558:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332240128:0@lo:103: 00000100:00100000:0.0:1789583647.576564:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332240640:0@lo:103: 00000100:00100000:0.0:1789583647.576590:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240384:0@lo:103: 00000100:00100000:0.0:1789583647.576596:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240896:0@lo:103: 00000100:00100000:0.0:1789583647.576602:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240256:0@lo:103: 00000100:00100000:0.0:1789583647.576608:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332240768:0@lo:103: 00000100:00100000:3.0:1789583647.576683:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583647.576745:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583647.576792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343488 00000100:00100000:2.0:1789583647.576797:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343488 00010000:00010000:2.0:1789583647.576855:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 10 pid: 5841 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583647.576875:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343616 00000100:00100000:2.0:1789583647.576878:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343616 00010000:00010000:2.0:1789583647.576889:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 11 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583647.576899:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583647.576904:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+11:2358:x1876514313343488:12345-192.168.203.46@tcp:103: 00010000:00010000:2.0:1789583647.576912:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583647.576916:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 11 pid: 5841 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.576924:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 11 pid: 5841 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.576942:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752ca000/0x6d3e73d72c6e2de0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62a0 expref: 11 pid: 5841 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.576951:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583647.576986:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313343488:12345-192.168.203.46@tcp:103: Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.576992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583647.577027:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:2.0:1789583647.577033:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+9:2358:x1876514313343616:12345-192.168.203.46@tcp:103: 00010000:00010000:2.0:1789583647.577039:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583647.577044:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 9 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577052:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 9 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577061:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2dd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6299 expref: 9 pid: 5842 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577072:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577080:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577093:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577101:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577113:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577120:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577125:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216fc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583647.577129:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577138:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577151:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583647.577160:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583647.577180:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+8:2358:x1876514313343616:12345-192.168.203.46@tcp:103: Request processed in 147us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.577187:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00010000:00010000:3.0:1789583647.577534:0:8465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.577543:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583647.577548:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e2e18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583647.787872:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332241024:0@lo:13: 00000100:00100000:0.0:1789583647.787941:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583647.788298:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241024 00000100:00100000:2.0:1789583647.788308:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241024 00000100:00100000:2.0:1789583647.788356:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789583647.788365:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332241024:12345-0@lo:13: 00002000:00000024:2.0:1789583647.788399:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583647.788448:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332241024:12345-0@lo:13: Request processed in 84us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583647.788456:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789583647.788509:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4ab480 x1876514332241024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583663 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583647.788529:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332241024:0@lo:13: 00010000:00010000:2.0:1789583648.295080:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789583648.871021:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789583648.871030:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b66de3b000 from 39 10000000:01000000:1.0:1789583648.871035:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789583648.871238:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583648.871251:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583648.871282:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583648.871306:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241152:0@lo:101: 00000100:00100000:1.0:1789583648.871378:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583648.871463:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583648.871717:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241152 00000100:00100000:2.0:1789583648.871726:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241152 00000100:00100000:2.0:1789583648.871783:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789583648.871792:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+12:5845:x1876514332241152:12345-0@lo:101: 00010000:00010000:2.0:1789583648.871916:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583648.871932:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e1f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.871954:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e1f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.871965:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e1f expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.871973:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f200, rc 0) 00000100:00100000:2.0:1789583648.872189:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332241152:12345-0@lo:101: Request processed in 397us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583648.872196:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789583648.872312:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241152:0@lo:101: 00010000:00010000:3.0:1789583648.872327:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.872336:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.872389:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241280:0@lo:501: 00000100:00100000:3.0:1789583648.872416:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.872543:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241280 00000100:00100000:0.0:1789583648.872548:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241280 00000100:00100000:0.0:1789583648.872579:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789583648.872586:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332241280:12345-0@lo:501: 00000100:00100000:0.0:1789583648.873238:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332241280:12345-0@lo:501: Request processed in 638us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.873246:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789583648.873334:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b658133900 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.873350:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241280:0@lo:501: 00000100:00100000:3.0:1789583648.873378:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241408:0@lo:503: 00000100:00100000:3.0:1789583648.873417:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.873440:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b658133900 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.873531:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241408 00000100:00100000:0.0:1789583648.873536:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241408 00000100:00100000:0.0:1789583648.873555:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789583648.873561:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332241408:12345-0@lo:503: 00000100:00100000:0.0:1789583648.873691:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332241408:12345-0@lo:503: Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.873704:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789583648.873763:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241408:0@lo:503: 00000100:00100000:0.0:1789583648.880970:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8481:1876514332241536:0@lo:502: 00000100:00100000:0.0:1789583648.881353:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.881407:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b647de2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.881560:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241536 00000100:00100000:3.0:1789583648.881568:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241536 00000100:00100000:3.0:1789583648.881620:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789583648.881637:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:8481:x1876514332241536:12345-0@lo:502: 00000100:00100000:3.0:1789583648.881914:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:8481:x1876514332241536:12345-0@lo:502: Request processed in 277us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.881931:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789583648.882408:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8481:1876514332241536:0@lo:502: 00000100:00100000:0.0:1789583648.882464:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8481:1876514332241664:0@lo:502: 00000100:00100000:0.0:1789583648.882500:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.882532:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b647de2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789583648.882650:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241664 00000100:00100000:2.0:1789583648.882656:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241664 00000100:00100000:2.0:1789583648.882690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789583648.882697:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:8481:x1876514332241664:12345-0@lo:502: 00000100:00100000:2.0:1789583648.882891:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:8481:x1876514332241664:12345-0@lo:502: Request processed in 193us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583648.882907:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789583648.883182:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8481:1876514332241664:0@lo:502: 00000040:00080000:0.0:1789583648.883199:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789583648.883423:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789583648.883452:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789583648.883460:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.883471:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583648.883480:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789583648.883483:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789583648.883485:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789583648.883508:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.883516:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.883526:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583648.883538:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241792:0@lo:101: 00000100:00100000:2.0:1789583648.883570:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583648.883597:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.883686:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241792 00000100:00100000:0.0:1789583648.883691:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241792 00000100:00100000:0.0:1789583648.883720:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789583648.883726:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+13:5845:x1876514332241792:12345-0@lo:101: 00010000:00010000:0.0:1789583648.883735:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583648.883745:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e2d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.883764:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e2d expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.883774:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e2d expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.883781:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cae00, rc 0) 00000100:00100000:0.0:1789583648.883962:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332241792:12345-0@lo:101: Request processed in 235us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.883977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789583648.884209:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241792:0@lo:101: 00010000:00010000:2.0:1789583648.884221:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.884239:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583648.884285:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241920:0@lo:501: 00000100:00100000:2.0:1789583648.884306:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583648.884329:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.884370:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332241920 00000100:00100000:3.0:1789583648.884374:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332241920 00000100:00100000:3.0:1789583648.884400:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789583648.884406:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332241920:12345-0@lo:501: 00000100:00100000:3.0:1789583648.884721:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332241920:12345-0@lo:501: Request processed in 314us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.884727:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789583648.884988:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332241920:0@lo:501: 00000100:00100000:2.0:1789583648.885176:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242048:0@lo:503: 00000100:00100000:2.0:1789583648.885210:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583648.885275:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.886915:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242048 00000100:00100000:0.0:1789583648.886926:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242048 00000100:00100000:0.0:1789583648.886982:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789583648.886991:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332242048:12345-0@lo:503: 00000100:00100000:0.0:1789583648.887487:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332242048:12345-0@lo:503: Request processed in 495us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.887494:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789583648.888734:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242048:0@lo:503: 00000100:00100000:1.0:1789583648.889369:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8482:1876514332242176:0@lo:502: 00000100:00100000:1.0:1789583648.889439:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583648.889550:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba900 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.889647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242176 00000100:00100000:0.0:1789583648.889654:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242176 00000100:00100000:0.0:1789583648.889697:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789583648.889706:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8482:x1876514332242176:12345-0@lo:502: 00000100:00100000:0.0:1789583648.890259:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8482:x1876514332242176:12345-0@lo:502: Request processed in 552us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.890267:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789583648.890393:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8482:1876514332242176:0@lo:502: 00000020:01000000:2.0:1789583648.890420:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583648.890428:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583648.890431:0:8482:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789583648.890438:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789583648.890532:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8482:1876514332242304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583648.890570:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583648.890601:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.890647:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242304 00000100:00100000:0.0:1789583648.890653:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242304 00000100:00100000:0.0:1789583648.890727:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789583648.890735:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8482:x1876514332242304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.890925:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:8482:x1876514332242304:12345-0@lo:502:llog_process_th.0 Request processed in 190us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.890932:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789583648.891318:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8482:1876514332242304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583648.891340:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583648.891345:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583648.891347:0:8482:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789583648.891351:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789583648.891574:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789583648.891590:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789583648.891599:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583648.891611:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583648.891621:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789583648.891623:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b64a171800 from 39 10000000:01000000:1.0:1789583648.891626:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789583648.891651:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583648.891659:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583648.891668:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583648.891695:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789583648.891726:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583648.905066:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.908233:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242432 00000100:00100000:3.0:1789583648.908251:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242432 00000100:00100000:3.0:1789583648.908313:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789583648.908323:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:5845:x1876514332242432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583648.908339:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583648.908358:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a02200/0x6d3e73d72c6e2e42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.908386:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a02200/0x6d3e73d72c6e2e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e3b expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.908397:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a02200/0x6d3e73d72c6e2e42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e3b expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.908406:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02200, rc 0) 00000100:00100000:3.0:1789583648.908492:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332242432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (16765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.908519:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789583648.909639:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583648.909663:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583648.909675:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583648.909746:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583648.909788:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583648.909845:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.909926:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242560 00000100:00100000:3.0:1789583648.909933:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242560 00000100:00100000:3.0:1789583648.909973:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789583648.909982:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332242560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.910381:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332242560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.910387:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789583648.911996:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583648.912051:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583648.912135:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583648.912176:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.912348:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242688 00000100:00100000:3.0:1789583648.912355:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242688 00000100:00100000:3.0:1789583648.912399:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789583648.912407:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332242688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.912591:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332242688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.912598:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789583648.912681:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332242688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.913051:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8483:1876514332242816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.913099:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.913135:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.913283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242816 00000100:00100000:3.0:1789583648.913289:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242816 00000100:00100000:3.0:1789583648.913312:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789583648.913319:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8483:x1876514332242816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583648.913487:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8483:x1876514332242816:12345-0@lo:502:llog_process_th.0 Request processed in 168us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.913493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789583648.913568:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8483:1876514332242816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.913606:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8483:1876514332242944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.913637:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.913658:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.913702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332242944 00000100:00100000:3.0:1789583648.913706:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332242944 00000100:00100000:3.0:1789583648.913721:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789583648.913726:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8483:x1876514332242944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583648.913875:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:8483:x1876514332242944:12345-0@lo:502:llog_process_th.0 Request processed in 147us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.913881:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789583648.913973:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8483:1876514332242944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789583648.913990:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789583648.914205:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789583648.914233:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789583648.914242:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914253:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583648.914263:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789583648.914266:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789583648.914268:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789583648.914291:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914299:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914309:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.914321:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.914349:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.914371:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645a2f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.914382:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243072 00000100:00100000:3.0:1789583648.914386:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243072 00000100:00100000:3.0:1789583648.914404:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789583648.914416:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:5845:x1876514332243072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583648.914424:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583648.914434:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a03a00/0x6d3e73d72c6e2e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914457:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a03a00/0x6d3e73d72c6e2e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e49 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914468:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a03a00/0x6d3e73d72c6e2e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e49 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914476:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03a00, rc 0) 00000100:00100000:3.0:1789583648.914504:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332243072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.914510:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789583648.914538:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583648.914549:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.914557:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.914596:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.914622:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.914635:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692000 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.914645:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243200 00000100:00100000:3.0:1789583648.914649:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243200 00000100:00100000:3.0:1789583648.914665:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789583648.914678:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332243200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.915400:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332243200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 720us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.915408:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789583648.915445:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.915474:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.915510:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.915524:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692000 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.915537:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243328 00000100:00100000:3.0:1789583648.915540:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243328 00000100:00100000:3.0:1789583648.915560:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789583648.915567:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332243328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.915691:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332243328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.915697:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789583648.915731:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583648.917292:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8484:1876514332243456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583648.917354:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583648.917433:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.917469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243456 00000100:00100000:3.0:1789583648.917475:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243456 00000100:00100000:3.0:1789583648.917541:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789583648.917550:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8484:x1876514332243456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583648.917757:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8484:x1876514332243456:12345-0@lo:502:llog_process_th.0 Request processed in 207us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.917763:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789583648.917997:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8484:1876514332243456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583648.918317:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583648.918325:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583648.918331:0:8484:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789583648.918338:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789583648.918359:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8484:1876514332243584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583648.918394:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583648.918455:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583648.918484:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243584 00000100:00100000:1.0:1789583648.918489:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243584 00000100:00100000:1.0:1789583648.918550:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789583648.918558:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8484:x1876514332243584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583648.918690:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:8484:x1876514332243584:12345-0@lo:502:llog_process_th.0 Request processed in 132us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583648.918696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789583648.918746:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8484:1876514332243584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583648.918761:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583648.918765:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583648.918766:0:8484:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789583648.918770:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789583648.919029:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789583648.919051:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789583648.919069:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.919080:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583648.919089:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789583648.919092:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b666645000 from 39 10000000:01000000:3.0:1789583648.919094:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789583648.919114:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.919121:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.919131:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.919143:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.919169:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.919371:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.919433:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243712 00000100:00100000:0.0:1789583648.919438:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243712 00000100:00100000:0.0:1789583648.919459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789583648.919466:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332243712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583648.919474:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583648.919484:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cb600/0x6d3e73d72c6e2e5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.919505:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cb600/0x6d3e73d72c6e2e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e57 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.919514:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cb600/0x6d3e73d72c6e2e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e57 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.919521:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cb600, rc 0) 00000100:00100000:0.0:1789583648.919555:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332243712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.919561:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789583648.919621:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583648.919631:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.919640:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.919674:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.919701:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.919718:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.919753:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243840 00000100:00100000:0.0:1789583648.919756:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243840 00000100:00100000:0.0:1789583648.919775:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789583648.919780:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332243840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.920364:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332243840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 582us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.920371:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789583648.920430:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.920457:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.920487:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.920513:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.920551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332243968 00000100:00100000:3.0:1789583648.920555:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332243968 00000100:00100000:3.0:1789583648.920572:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789583648.920577:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332243968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.920699:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332243968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.920706:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789583648.920762:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332243968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.921313:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8485:1876514332244096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.921350:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.921376:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64355ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.921418:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244096 00000100:00100000:3.0:1789583648.921423:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244096 00000100:00100000:3.0:1789583648.921441:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789583648.921447:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8485:x1876514332244096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583648.921602:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8485:x1876514332244096:12345-0@lo:502:llog_process_th.0 Request processed in 154us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.921608:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789583648.921714:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8485:1876514332244096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.921749:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8485:1876514332244224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.921781:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.921854:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b9300 going to sleep for 11 seconds 00000100:00100000:3.0:1789583648.921993:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244224 00000100:00100000:3.0:1789583648.921997:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244224 00000100:00100000:3.0:1789583648.922017:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789583648.922024:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8485:x1876514332244224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583648.922290:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8485:x1876514332244224:12345-0@lo:502:llog_process_th.0 Request processed in 267us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583648.922296:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789583648.922372:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8485:1876514332244224:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789583648.922390:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789583648.922532:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789583648.922551:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789583648.922559:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.922568:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583648.922577:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789583648.922580:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789583648.922583:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789583648.922606:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.922613:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.922622:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.922635:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.922661:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.922683:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.922728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244352 00000100:00100000:0.0:1789583648.922732:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244352 00000100:00100000:0.0:1789583648.922752:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789583648.922758:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332244352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583648.922766:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583648.922776:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cb200/0x6d3e73d72c6e2e6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.922962:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cb200/0x6d3e73d72c6e2e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e65 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.922972:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cb200/0x6d3e73d72c6e2e6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e65 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.922980:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cb200, rc 0) 00000100:00100000:0.0:1789583648.923007:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332244352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.923012:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789583648.923194:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583648.923208:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583648.923217:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583648.923280:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.923306:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.923334:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.923380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244480 00000100:00100000:0.0:1789583648.923385:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244480 00000100:00100000:0.0:1789583648.923403:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789583648.923409:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332244480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.923625:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332244480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.923632:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789583648.923695:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.923719:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583648.923755:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583648.923777:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583648.924215:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244608 00000100:00100000:1.0:1789583648.924231:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244608 00000100:00100000:1.0:1789583648.924261:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789583648.924268:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332244608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583648.924414:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332244608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583648.924419:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789583648.924503:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.925283:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8486:1876514332244736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.925331:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.925399:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789583648.925431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244736 00000100:00100000:1.0:1789583648.925437:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244736 00000100:00100000:1.0:1789583648.925493:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789583648.925501:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8486:x1876514332244736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583648.925689:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8486:x1876514332244736:12345-0@lo:502:llog_process_th.0 Request processed in 189us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583648.925696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789583648.925764:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8486:1876514332244736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583648.925790:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583648.925828:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583648.925831:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789583648.925841:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789583648.925861:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8486:1876514332244864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583648.925893:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583648.926331:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b648e48a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583648.926407:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244864 00000100:00100000:0.0:1789583648.926413:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244864 00000100:00100000:0.0:1789583648.926439:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789583648.926446:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8486:x1876514332244864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583648.926618:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8486:x1876514332244864:12345-0@lo:502:llog_process_th.0 Request processed in 171us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583648.926634:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789583648.926704:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8486:1876514332244864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583648.926724:0:8486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583648.926728:0:8486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583648.926730:0:8486:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789583648.926734:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789583648.927019:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789583648.927039:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789583648.927049:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.927179:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583648.927191:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789583648.927194:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b648de8000 from 1 10000000:01000000:0.0:1789583648.927197:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789583648.927233:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.927242:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.927251:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583648.927267:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.927300:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.927333:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789583648.927376:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332244992 00000100:00100000:2.0:1789583648.927381:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332244992 00000100:00100000:2.0:1789583648.927402:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789583648.927408:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332244992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583648.927417:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583648.927433:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.927453:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e73 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.927463:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e73 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583648.927470:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216ec00, rc 0) 00000100:00100000:2.0:1789583648.927536:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332244992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583648.927542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789583648.927686:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332244992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583648.927699:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.927716:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583648.927758:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332245120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583648.927781:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583648.928212:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789583648.928248:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245120 00000100:00100000:2.0:1789583648.928253:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245120 00000100:00100000:2.0:1789583648.928316:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789583648.928323:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332245120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583648.928525:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332245120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (742us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789583648.928531:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789583648.928581:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332245120:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789583648.928607:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789583648.928612:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583648.928620:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583649.319488:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583650.343299:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583651.254385:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583651.254534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343744 00000100:00100000:3.0:1789583651.254545:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343744 00000100:00100000:3.0:1789583651.254619:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:3.0:1789583651.254630:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+8:5599:x1876514313343744:12345-192.168.203.46@tcp:101: 00010000:00010000:3.0:1789583651.254655:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583651.254673:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a03200/0x6d3e73d72c6e2e81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6302 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583651.254702:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a03200/0x6d3e73d72c6e2e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6302 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583651.254712:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a03200/0x6d3e73d72c6e2e81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6302 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583651.254721:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03200, rc 0) 00000100:00100000:3.0:1789583651.254786:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313343744:12345-192.168.203.46@tcp:101: Request processed in 158us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583651.254854:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:3.0:1789583651.257921:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583651.258102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313343872 00000100:00100000:2.0:1789583651.258111:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313343872 00000100:00100000:2.0:1789583651.258245:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 165 00000100:00100000:2.0:1789583651.258255:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313343872:12345-192.168.203.46@tcp:501: 00000100:00100000:2.0:1789583651.258562:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313343872:12345-192.168.203.46@tcp:501: Request processed in 307us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583651.258570:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 165 00000100:00100000:0.0:1789583651.268708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583651.268869:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344000 00000100:00100000:3.0:1789583651.268880:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344000 00000100:00100000:3.0:1789583651.268941:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:3.0:1789583651.268952:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313344000:12345-192.168.203.46@tcp:503: 00000100:00100000:3.0:1789583651.269179:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313344000:12345-192.168.203.46@tcp:503: Request processed in 228us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583651.269188:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:3.0:1789583651.273025:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583651.273296:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344128 00000100:00100000:2.0:1789583651.273306:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344128 00000100:00100000:2.0:1789583651.273438:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 167 00000100:00100000:2.0:1789583651.273449:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:6082:x1876514313344128:12345-192.168.203.46@tcp:502: 00000100:00100000:2.0:1789583651.274118:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:6082:x1876514313344128:12345-192.168.203.46@tcp:502: Request processed in 669us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583651.274127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 167 00000100:00100000:0.0:1789583651.283105:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583651.283543:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344256 00000100:00100000:1.0:1789583651.283558:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344256 00000100:00100000:1.0:1789583651.284120:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:1.0:1789583651.284136:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+9:6082:x1876514313344256:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583651.285351:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+9:6082:x1876514313344256:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 1210us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583651.285364:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:0.0:1789583651.297343:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583651.297482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344384 00000100:00100000:2.0:1789583651.297498:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344384 00000100:00100000:2.0:1789583651.297579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 169 00000100:00100000:2.0:1789583651.297590:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313344384:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583651.297607:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583651.297626:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2e88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6309 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583651.297665:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6309 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583651.297677:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2e88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6309 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583651.297686:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f800, rc 0) 00000100:00100000:2.0:1789583651.297761:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313344384:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 173us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583651.297769:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 169 00000100:00100000:3.0:1789583651.301459:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583651.301914:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344512 00000100:00100000:1.0:1789583651.301939:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344512 00000100:00100000:1.0:1789583651.301998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 170 00000100:00100000:1.0:1789583651.302008:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313344512:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583651.302711:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313344512:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 701us (1257us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583651.302720:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 170 00010000:00010000:2.0:1789583651.369749:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583652.390995:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583652.391018:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332245248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583652.391119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583652.391183:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245248 00000100:00100000:2.0:1789583652.391191:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245248 00000100:00100000:2.0:1789583652.391251:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789583652.391260:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332245248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583652.391293:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583652.391336:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332245248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583652.391343:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789583652.391366:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789583652.391396:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67badf100 x1876514332245248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583652.391413:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332245248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583652.391680:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332245504:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.391713:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583652.391745:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789583652.391751:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332245376:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.391777:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583652.391799:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332245888:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.391835:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583652.391858:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332245760:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.391888:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583652.391902:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583652.391907:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332245632:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.391925:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583652.391949:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245376 00000100:00100000:3.0:1789583652.391953:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245376 00000100:00100000:3.0:1789583652.392027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789583652.392034:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332245376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392070:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332245376:12345-0@lo:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.392076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789583652.392100:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245888 00000100:00100000:3.0:1789583652.392104:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245888 00000100:00100000:3.0:1789583652.392129:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789583652.392136:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332245888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392166:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332245888:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.392171:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789583652.392189:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245504 00000100:00100000:3.0:1789583652.392192:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245504 00000100:00100000:3.0:1789583652.392229:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245760 00000100:00100000:3.0:1789583652.392232:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245760 00000100:00100000:3.0:1789583652.392245:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332245632 00000100:00100000:3.0:1789583652.392248:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332245632 00000100:00100000:3.0:1789583652.392262:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789583652.392268:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332245504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392298:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332245504:12345-0@lo:400:kworker.0 Request processed in 30us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.392304:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789583652.392315:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789583652.392321:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332245760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392349:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332245760:12345-0@lo:400:kworker.0 Request processed in 29us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.392364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789583652.392376:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789583652.392382:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332245632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392416:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332245632:12345-0@lo:400:kworker.0 Request processed in 35us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.392422:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789583652.392457:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332245632:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392467:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332245760:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392492:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332245376:0@lo:400:kworker.0 00010000:00080000:3.0:1789583652.392503:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4a9880 x1876514332245888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583652.392512:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332245888:0@lo:400:kworker.0 00000100:00100000:3.0:1789583652.392522:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332245504:0@lo:400:kworker.0 00000100:00080000:2.0:1789583652.392770:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583652.392774:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789583652.394545:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583652.419226:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583652.419269:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583652.419307:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583652.419337:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583652.419366:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345024 00000100:00100000:2.0:1789583652.419374:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345024 00000100:00100000:2.0:1789583652.419424:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344896 00000100:00100000:2.0:1789583652.419426:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344896 00000100:00100000:2.0:1789583652.419441:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789583652.419449:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313345024:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583652.419513:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313345024:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583652.419536:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789583652.419556:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789583652.419563:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313344896:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583652.419592:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313344896:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583652.419598:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:3.0:1789583652.419841:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344768 00000100:00100000:3.0:1789583652.419847:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344768 00000100:00100000:3.0:1789583652.419893:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:3.0:1789583652.419902:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313344768:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583652.419935:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313344768:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 34us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.419942:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00080000:2.0:1789583652.420771:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583652.420778:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583652.420781:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583652.421714:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313344640 00000100:00100000:1.0:1789583652.421724:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313344640 00000100:00100000:1.0:1789583652.421778:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 172 00000100:00100000:1.0:1789583652.421787:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313344640:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583652.421883:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313344640:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 88us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583652.421891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 172 00000020:00000080:1.0:1789583652.868859:0:8525:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7ac564d0 20000000:00000080:1.0:1789583652.868885:0:8525:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b6757e4c00 uarg=0000000000000000 20000000:01000000:1.0:1789583652.868986:0:8525:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789583652.868992:0:8525:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789583652.868997:0:8525:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789583652.870280:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789583652.870558:0:8525:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789583652.875593:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789583652.875653:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789583652.875703:0:8525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789583652.875720:0:8525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789583652.875740:0:8525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875758:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875767:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875773:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875783:0:8525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875790:0:8525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875868:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.875885:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 9 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583652.875900:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246016:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583652.876010:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.876019:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 18 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583652.876028:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246144:0@lo:104: 00000100:00100000:2.0:1789583652.876064:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789583652.876099:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.876107:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 18 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583652.876115:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246272:0@lo:104: 00000100:00100000:2.0:1789583652.876139:0:8525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789583652.876158:0:8525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583652.876166:0:8525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 18 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583652.876186:0:8525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246400:0@lo:104: 00000100:00100000:2.0:1789583652.876219:0:8525:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583652.876595:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789583652.876616:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583652.876628:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246144 00000100:00100000:1.0:1789583652.876635:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246144 00000100:00100000:1.0:1789583652.876671:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246272 00000100:00100000:1.0:1789583652.876675:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246272 00000100:00100000:1.0:1789583652.876685:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246400 00000100:00100000:1.0:1789583652.876688:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246400 00000100:00100000:1.0:1789583652.876699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789583652.876716:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:8525:x1876514332246144:12345-0@lo:104: 00010000:00010000:1.0:1789583652.876728:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.876790:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583652.876795:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:8525:x1876514332246144:12345-0@lo:104: Request processed in 83us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583652.876801:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789583652.876833:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789583652.876840:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:8525:x1876514332246272:12345-0@lo:104: 00010000:00010000:1.0:1789583652.876846:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.876880:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789583652.876885:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:8525:x1876514332246272:12345-0@lo:104: Request processed in 46us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583652.876890:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789583652.876921:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789583652.876928:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:8525:x1876514332246400:12345-0@lo:104: 00010000:00010000:1.0:1789583652.876935:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.876967:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789583652.876972:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:8525:x1876514332246400:12345-0@lo:104: Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583652.876978:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789583652.876997:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789583652.877009:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877015:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583652.877019:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877028:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583652.877035:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583652.877040:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789583652.877069:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877075:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583652.877095:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877101:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e2d2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2d31 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877114:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789583652.877117:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877123:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583652.877125:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877142:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583652.877148:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583652.877154:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789583652.877167:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877173:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583652.877189:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877205:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfbc00/0x6d3e73d72c6e2c5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877214:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583652.877216:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877222:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583652.877225:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877232:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583652.877238:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583652.877250:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789583652.877264:0:5837:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877270:0:5837:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583652.877276:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877281:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2bfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2c04 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.877296:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583652.877297:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583652.877299:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583652.877306:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583652.877311:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583652.877321:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332246528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583652.878045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583652.878107:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332246656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583652.878132:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583652.878151:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583652.878157:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332246784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583652.878177:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583652.878218:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246528 00000100:00100000:1.0:1789583652.878224:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246528 00010000:00010000:1.0:1789583652.878249:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 19 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583652.878279:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246656 00000100:00100000:1.0:1789583652.878283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246656 00010000:00010000:1.0:1789583652.878295:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 20 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583652.878304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246784 00000100:00100000:1.0:1789583652.878306:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246784 00010000:00010000:1.0:1789583652.878315:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 21 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583652.878442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789583652.878452:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3306:x1876514332246528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789583652.878464:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583652.878469:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 21 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.878479:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 21 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583652.878494:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583652.878527:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3306:x1876514332246528:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (483us total) trans 0 rc 0/0 00010000:00010000:2.0:1789583652.879696:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cac00/0x6d3e73d72c6e2d31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2d2a expref: 21 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583652.879712:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246144:0@lo:104: 00000100:00100000:2.0:1789583652.879724:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246272:0@lo:104: 00000100:00100000:2.0:1789583652.879733:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246400:0@lo:104: 00000100:00100000:2.0:1789583652.879896:0:5833:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789583652.879905:0:5833:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789583652.880699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789583652.880713:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3307:x1876514332246656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789583652.880739:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583652.880748:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 20 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.880760:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 20 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.880775:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b640031e00/0x6d3e73d72c6e2c66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2c5f expref: 20 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.880788:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583652.880862:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332246656:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.880870:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789583652.880892:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789583652.880899:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:3307:x1876514332246784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789583652.880908:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583652.880913:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 18 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.880920:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 18 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.880929:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641483800/0x6d3e73d72c6e2c04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2bfd expref: 18 pid: 5842 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.880937:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583652.880959:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:3307:x1876514332246784:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.880974:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789583652.881062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583652.881079:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345152 00000100:00100000:3.0:1789583652.881085:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345152 00010000:00010000:3.0:1789583652.881104:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583652.881122:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:3.0:1789583652.881128:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313345152:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583652.881137:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583652.881142:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881152:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 10 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881164:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881172:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881187:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881205:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881212:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881226:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881232:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216e400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583652.881236:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881244:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881254:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881264:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583652.881303:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313345152:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 174us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.881310:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00010000:00010000:3.0:1789583652.881361:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e2dee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62d1 expref: 9 pid: 5841 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583652.881373:0:8525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8525:1876514332246016:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583652.881399:0:8525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881409:0:8525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881415:0:8525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583652.881432:0:8525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e2e8f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583652.882572:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789583652.882719:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332246784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583652.882730:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332246656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583652.882757:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332246528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583652.907513:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332246912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583652.907598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583652.907831:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332246912 00000100:00100000:3.0:1789583652.907839:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332246912 00000100:00100000:3.0:1789583652.907888:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789583652.907898:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332246912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583652.907932:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583652.907981:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332246912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583652.907989:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789583652.908029:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4a9880 x1876514332246912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583652.908048:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332246912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583653.165303:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583653.165474:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345280 00000100:00100000:2.0:1789583653.165484:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345280 00000100:00100000:2.0:1789583653.165541:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:2.0:1789583653.165551:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+9:5599:x1876514313345280:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583653.165567:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583653.165584:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6310 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583653.165611:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583653.165622:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583653.165630:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f400, rc 0) 00000100:00100000:2.0:1789583653.165689:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313345280:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 139us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583653.165712:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:1.0:1789583653.178925:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583653.179023:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345408 00000100:00100000:2.0:1789583653.179034:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345408 00000100:00100000:2.0:1789583653.179102:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:2.0:1789583653.179112:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313345408:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583653.179583:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313345408:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 471us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583653.179592:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:3.0:1789583653.181442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583653.181654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345536 00000100:00100000:1.0:1789583653.181663:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345536 00000100:00100000:1.0:1789583653.181718:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 175 00000100:00100000:1.0:1789583653.181728:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313345536:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583653.181957:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:5599:x1876514313345536:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 230us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583653.181965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 175 00000100:00100000:3.0:1789583653.188068:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583653.188219:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345664 00000100:00100000:2.0:1789583653.188229:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345664 00000100:00100000:2.0:1789583653.188286:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 176 00000100:00100000:2.0:1789583653.188296:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:6125:x1876514313345664:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789583653.188679:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:6125:x1876514313345664:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 383us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583653.188687:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 176 00000100:00100000:2.0:1789583653.195032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583653.196629:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345792 00000100:00100000:0.0:1789583653.196762:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345792 00000100:00100000:0.0:1789583653.196908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 177 00000100:00100000:0.0:1789583653.196921:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:6125:x1876514313345792:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789583653.197188:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:6125:x1876514313345792:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 269us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583653.197212:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 177 00010000:00010000:1.0:1789583653.415099:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583654.440354:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789583654.889618:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789583654.889626:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b66de3b000 from 4 10000000:01000000:2.0:1789583654.889630:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789583654.889674:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583654.889686:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583654.889697:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583654.889734:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.889825:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583654.889875:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789583654.889983:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247040 00000100:00100000:3.0:1789583654.889991:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247040 00000100:00100000:3.0:1789583654.890057:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789583654.890066:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332247040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583654.890079:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583654.890092:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2e9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583654.890114:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583654.890132:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583654.890141:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02a00, rc 0) 00000100:00100000:3.0:1789583654.890190:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332247040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583654.890198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789583654.890406:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583654.890419:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583654.890428:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583654.890476:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.890499:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583654.890522:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.890559:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247168 00000100:00100000:0.0:1789583654.890564:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247168 00000100:00100000:0.0:1789583654.890592:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789583654.890599:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332247168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.891057:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332247168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 457us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.891064:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789583654.892376:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.892420:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.892468:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583654.892547:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58f540 going to sleep for 11 seconds 00000100:00100000:3.0:1789583654.893514:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247296 00000100:00100000:3.0:1789583654.893522:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247296 00000100:00100000:3.0:1789583654.893571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789583654.893579:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332247296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583654.893767:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332247296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583654.893774:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789583654.893892:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.894069:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8625:1876514332247424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583654.894118:0:8625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.894141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247424 00000100:00100000:0.0:1789583654.894145:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247424 00000100:00100000:0.0:1789583654.894165:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789583654.894172:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8625:x1876514332247424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583654.894297:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8625:x1876514332247424:12345-0@lo:502:llog_process_th.0 Request processed in 125us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.894304:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789583654.894353:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.894365:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8625:1876514332247424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789583654.894387:0:8625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583654.894396:0:8625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583654.894399:0:8625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789583654.894405:0:8625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b66de3b000 00000020:00000080:0.0:1789583654.894407:0:8625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789583654.894476:0:8625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8625:1876514332247552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583654.894504:0:8625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.894522:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247552 00000100:00100000:0.0:1789583654.894525:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247552 00000100:00100000:0.0:1789583654.894542:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789583654.894547:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8625:x1876514332247552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583654.894640:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:8625:x1876514332247552:12345-0@lo:502:llog_process_th.0 Request processed in 92us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.894646:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789583654.894669:0:8625:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.894678:0:8625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8625:1876514332247552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789583654.894692:0:8625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583654.894695:0:8625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583654.894696:0:8625:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789583654.894699:0:8625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789583654.894741:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789583654.894759:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789583654.894766:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.894775:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583654.894783:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789583654.894794:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b64a171800 from 4 10000000:01000000:0.0:1789583654.894797:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789583654.894836:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.894852:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.894860:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583654.894870:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.894892:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.894904:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.894913:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247680 00000100:00100000:0.0:1789583654.894915:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247680 00000100:00100000:0.0:1789583654.894930:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789583654.894934:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332247680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583654.894941:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583654.894950:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2eab expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.894967:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.894975:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.894981:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752caa00, rc 0) 00000100:00100000:0.0:1789583654.895004:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332247680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.895009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789583654.895037:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583654.895046:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.895053:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583654.895084:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.895107:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.895118:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.895127:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247808 00000100:00100000:0.0:1789583654.895130:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247808 00000100:00100000:0.0:1789583654.895145:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789583654.895150:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332247808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.895328:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332247808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.895334:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789583654.895359:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.895378:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.895405:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.895415:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.895423:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332247936 00000100:00100000:0.0:1789583654.895426:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332247936 00000100:00100000:0.0:1789583654.895438:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789583654.895442:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332247936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.895536:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332247936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.895548:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789583654.895580:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332247936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583654.910611:0:8626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8626:1876514332248064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583654.911202:0:8626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583654.911248:0:8626:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813a63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.911665:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248064 00000100:00100000:0.0:1789583654.911674:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248064 00000100:00100000:0.0:1789583654.911875:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789583654.911885:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8626:x1876514332248064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583654.912080:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8626:x1876514332248064:12345-0@lo:502:llog_process_th.0 Request processed in 196us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.912087:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789583654.912698:0:8626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8626:1876514332248064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789583654.912727:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789583654.912735:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583654.912737:0:8626:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789583654.912745:0:8626:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b64a171800 00000020:00000080:1.0:1789583654.912747:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789583654.912844:0:8626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8626:1876514332248192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583654.912883:0:8626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583654.914207:0:8626:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645a2fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583654.917512:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248192 00000100:00100000:3.0:1789583654.917538:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248192 00000100:00100000:3.0:1789583654.917580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789583654.917590:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8626:x1876514332248192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583654.917849:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:8626:x1876514332248192:12345-0@lo:502:llog_process_th.0 Request processed in 260us (4964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583654.917856:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789583654.920046:0:8626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8626:1876514332248192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789583654.920090:0:8626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789583654.920098:0:8626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583654.920107:0:8626:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789583654.920114:0:8626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789583654.921023:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789583654.921044:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789583654.921053:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921064:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583654.921074:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789583654.921077:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666645000 from 4 10000000:01000000:0.0:1789583654.921079:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789583654.921111:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921119:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921128:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583654.921164:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332248320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.921233:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.921276:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.921295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248320 00000100:00100000:0.0:1789583654.921300:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248320 00000100:00100000:0.0:1789583654.921338:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789583654.921346:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332248320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583654.921357:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583654.921368:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2eb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921388:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921399:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921408:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca200, rc 0) 00000100:00100000:0.0:1789583654.921443:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332248320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.921448:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789583654.921485:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332248320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583654.921496:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583654.921504:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583654.921553:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332248448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.921576:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583654.921589:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.921599:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248448 00000100:00100000:0.0:1789583654.921603:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248448 00000100:00100000:0.0:1789583654.921619:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789583654.921624:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332248448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583654.924552:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332248448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2920us (2967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.924575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789583654.930958:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332248448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.931016:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332248576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.931079:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583654.931116:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789583654.931141:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248576 00000100:00100000:2.0:1789583654.931146:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248576 00000100:00100000:2.0:1789583654.931244:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789583654.931258:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332248576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.931432:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332248576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583654.931440:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789583654.938948:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332248576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583654.939159:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8632:1876514332248704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583654.939236:0:8632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583654.939266:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789583654.939910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248704 00000100:00100000:0.0:1789583654.939918:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248704 00000100:00100000:0.0:1789583654.939960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789583654.939967:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:8632:x1876514332248704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583654.940166:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:8632:x1876514332248704:12345-0@lo:502:llog_process_th.0 Request processed in 198us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583654.940173:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789583654.940700:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8632:1876514332248704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583654.940727:0:8632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583654.940734:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583654.940736:0:8632:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789583654.940744:0:8632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b666645000 00000020:00000080:2.0:1789583654.940746:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789583654.941598:0:8632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8632:1876514332248832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583654.941656:0:8632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583654.941687:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248832 00000100:00100000:2.0:1789583654.941692:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248832 00000100:00100000:2.0:1789583654.941724:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789583654.941730:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:8632:x1876514332248832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583654.942002:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:8632:x1876514332248832:12345-0@lo:502:llog_process_th.0 Request processed in 271us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583654.942008:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789583654.942046:0:8632:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58f780 going to sleep for 11 seconds 00000100:00100000:2.0:1789583654.942059:0:8632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:8632:1876514332248832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789583654.942083:0:8632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583654.942087:0:8632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583654.942089:0:8632:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789583654.942094:0:8632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789583654.942145:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789583654.942159:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789583654.942168:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583654.942187:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583655.463158:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583656.488012:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583657.511104:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332249344:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511180:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583657.511232:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789583657.511238:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332248960:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511265:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583657.511285:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332249472:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511343:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583657.511369:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332249088:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583657.511408:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332249600:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511429:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583657.511447:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583657.511452:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332249216:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583657.511501:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249344 00000100:00100000:1.0:1789583657.511509:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249344 00000100:00100000:1.0:1789583657.511556:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249600 00000100:00100000:1.0:1789583657.511559:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249600 00000100:00100000:1.0:1789583657.511576:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583657.511586:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332249344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511632:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332249344:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583657.511639:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583657.511653:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583657.511667:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332249600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511695:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332249600:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583657.511700:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583657.511716:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332248960 00000100:00100000:1.0:1789583657.511718:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332248960 00000100:00100000:1.0:1789583657.511738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789583657.511744:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332248960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511780:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332248960:12345-0@lo:400:kworker.0 Request processed in 37us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583657.511786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789583657.511830:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249472 00000100:00100000:1.0:1789583657.511833:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249472 00000100:00100000:1.0:1789583657.511855:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249088 00000100:00100000:1.0:1789583657.511857:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249088 00000100:00100000:1.0:1789583657.511865:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249216 00000100:00100000:1.0:1789583657.511867:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249216 00000100:00100000:1.0:1789583657.511878:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789583657.511883:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332249472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511919:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332249472:12345-0@lo:400:kworker.0 Request processed in 36us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583657.511924:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789583657.511934:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789583657.511939:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332249088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.511959:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332249088:12345-0@lo:400:kworker.0 Request processed in 20us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583657.511964:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789583657.511979:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789583657.511985:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332249216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.512006:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332249216:12345-0@lo:400:kworker.0 Request processed in 22us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583657.512011:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1789583657.512031:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583657.512036:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583657.512038:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583657.512067:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332249216:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.512076:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332249088:0@lo:400:kworker.0 00010000:00080000:1.0:1789583657.512086:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648883800 x1876514332249600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583657.512096:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332249600:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.512116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332248960:0@lo:400:kworker.0 00000100:00100000:1.0:1789583657.512124:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332249472:0@lo:400:kworker.0 00010000:00080000:1.0:1789583657.512132:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880000 x1876514332249344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583673 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583657.512140:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332249344:0@lo:400:kworker.0 00000100:00100000:2.0:1789583657.512825:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332249728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583657.512862:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583657.512923:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249728 00000100:00100000:3.0:1789583657.512928:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249728 00000100:00100000:3.0:1789583657.512960:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789583657.512966:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332249728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583657.512990:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583657.514130:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332249728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1159us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583657.514139:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789583657.514337:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1789583657.514382:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880000 x1876514332249728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583657.514400:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332249728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583657.526381:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583657.526424:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583657.526450:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583657.526472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583657.526499:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346176 00000100:00100000:3.0:1789583657.526509:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346176 00000100:00100000:3.0:1789583657.526562:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346304 00000100:00100000:3.0:1789583657.526565:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346304 00000100:00100000:3.0:1789583657.526585:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583657.526593:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313346176:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583657.526655:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313346176:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 63us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583657.526663:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583657.526679:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789583657.526685:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313346304:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583657.526710:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313346304:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583657.526715:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789583657.526730:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346048 00000100:00100000:3.0:1789583657.526733:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346048 00000100:00100000:3.0:1789583657.526759:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789583657.526765:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313346048:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583657.526795:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313346048:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583657.526833:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00080000:3.0:1789583657.526854:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789583657.526858:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583657.526860:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583657.526931:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313345920 00000100:00100000:2.0:1789583657.526935:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313345920 00000100:00100000:2.0:1789583657.526973:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:2.0:1789583657.526980:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2360:x1876514313345920:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583657.527007:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2360:x1876514313345920:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583657.527013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:3.0:1789583658.023046:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332249856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583658.023113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583658.023197:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249856 00000100:00100000:3.0:1789583658.023204:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249856 00000100:00100000:3.0:1789583658.023248:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789583658.023258:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332249856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583658.023290:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583658.023331:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332249856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583658.023338:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789583658.023377:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c4a8e00 x1876514332249856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583658.023394:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332249856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583658.536981:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789583659.395980:0:8827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789583659.560960:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583660.584074:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583661.610581:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583662.631459:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332249984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583662.631523:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631589:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332250496:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.631629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631657:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789583662.631664:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332250368:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.631688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631715:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332250112:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.631763:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631786:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332250624:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.631825:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631844:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789583662.631850:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332250240:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.631871:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631887:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332250752:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.631904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583662.631930:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332249984 00000100:00100000:1.0:1789583662.631937:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332249984 00000100:00100000:1.0:1789583662.631988:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789583662.631999:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332249984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583662.632030:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583662.632072:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332249984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632079:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789583662.632100:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250496 00000100:00100000:1.0:1789583662.632103:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250496 00000100:00100000:1.0:1789583662.632135:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250752 00000100:00100000:1.0:1789583662.632138:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250752 00000100:00100000:1.0:1789583662.632153:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789583662.632167:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332250496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632199:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332250496:12345-0@lo:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632205:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789583662.632217:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789583662.632224:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332250752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632254:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332250752:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632260:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789583662.632277:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250368 00000100:00100000:1.0:1789583662.632281:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250368 00000100:00100000:1.0:1789583662.632318:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250624 00000100:00100000:1.0:1789583662.632321:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250624 00000100:00100000:1.0:1789583662.632331:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250240 00000100:00100000:1.0:1789583662.632334:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250240 00000100:00100000:1.0:1789583662.632344:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789583662.632350:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332250368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632393:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332250368:12345-0@lo:400:kworker.0 Request processed in 43us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632399:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789583662.632411:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789583662.632418:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332250624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632446:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332250624:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632452:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789583662.632463:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789583662.632469:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332250240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632502:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332250240:12345-0@lo:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632508:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789583662.632527:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250112 00000100:00100000:1.0:1789583662.632531:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250112 00000100:00100000:1.0:1789583662.632553:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789583662.632560:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332250112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632588:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332250112:12345-0@lo:400:kworker.0 Request processed in 29us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.632595:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1789583662.632628:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583662.632632:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583662.632634:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583662.632667:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332250240:0@lo:400:kworker.0 00010000:00080000:1.0:1789583662.632680:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97e300 x1876514332250752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583662.632690:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332250752:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632699:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332250112:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632707:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332250624:0@lo:400:kworker.0 00000100:00100000:1.0:1789583662.632740:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332250368:0@lo:400:kworker.0 00010000:00080000:1.0:1789583662.632750:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880380 x1876514332249984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583662.632763:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332249984:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789583662.632783:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648882680 x1876514332250496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583662.632791:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332250496:0@lo:400:kworker.0 00010000:00010000:2.0:1789583662.636313:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583662.654861:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583662.654913:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583662.655016:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583662.655201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583662.655311:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346432 00000100:00100000:2.0:1789583662.655323:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346432 00000100:00100000:2.0:1789583662.655450:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 196 00000100:00100000:2.0:1789583662.655461:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313346432:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583662.655619:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313346432:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 160us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583662.655628:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 196 00000100:00100000:3.0:1789583662.656166:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346560 00000100:00100000:3.0:1789583662.656180:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346560 00000100:00100000:3.0:1789583662.656253:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:3.0:1789583662.656263:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313346560:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583662.656358:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313346560:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 96us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583662.656438:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789583662.659414:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346688 00000100:00100000:1.0:1789583662.659435:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346688 00000100:00100000:1.0:1789583662.659517:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346816 00000100:00100000:1.0:1789583662.659519:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346816 00000100:00100000:1.0:1789583662.659546:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:1.0:1789583662.659558:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2357:x1876514313346688:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:1.0:1789583662.659606:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2dfc 00000100:00080000:1.0:1789583662.659618:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b67525b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789583662.659668:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789583662.660097:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+2:2357:x1876514313346688:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 538us (5249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.660107:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:1.0:1789583662.660140:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:1.0:1789583662.660148:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2357:x1876514313346816:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:1.0:1789583662.660167:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2e03 00000100:00080000:1.0:1789583662.660175:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b674e3e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789583662.660199:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1789583662.663702:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789583662.663713:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789583662.663717:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583662.664320:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+2:2357:x1876514313346816:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 4158us (9390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583662.664338:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00010000:00010000:1.0:1789583662.664442:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583662.664926:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583663.143574:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583663.143596:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332250880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583663.143670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583663.143736:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332250880 00000100:00100000:0.0:1789583663.143744:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332250880 00000100:00100000:0.0:1789583663.143788:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789583663.143829:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332250880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583663.143863:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583663.143915:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332250880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583663.143922:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789583663.143972:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e3800 x1876514332250880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583663.143990:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332250880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789583663.661524:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789583664.558304:0:9071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing yml_node 00010000:00010000:0.0:1789583664.684145:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583665.703741:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583666.727050:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583666.764311:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:3.0:1789583666.764321:0:7663:0:(genops.c:885:class_export_put()) final put ffff88b674e3c000/768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:3.0:1789583666.764346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b674e3c000/768b736a-7b4a-4614-9d07-b155a4183a8a for lustre-OST0001 00000020:00000080:3.0:1789583666.764390:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b674e3e800 for lustre-OST0001 00010000:00010000:0.0:1789583667.751999:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583667.756991:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332251136:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757063:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583667.757120:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332251648:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757148:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583667.757175:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789583667.757181:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332251264:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757201:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583667.757217:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332251776:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757240:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583667.757269:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251136 00000100:00100000:1.0:1789583667.757277:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251136 00000100:00100000:1.0:1789583667.757318:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789583667.757327:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332251136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757374:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332251136:12345-0@lo:400:kworker.0 Request processed in 48us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.757381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789583667.757410:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251648 00000100:00100000:1.0:1789583667.757414:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251648 00000100:00100000:1.0:1789583667.757442:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251264 00000100:00100000:1.0:1789583667.757444:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251264 00000100:00100000:1.0:1789583667.757457:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583667.757462:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332251648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757490:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332251648:12345-0@lo:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.757495:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583667.757505:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789583667.757510:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332251264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757545:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332251264:12345-0@lo:400:kworker.0 Request processed in 35us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.757550:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789583667.757607:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332251264:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757618:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332251136:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757627:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332251648:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757675:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251776 00000100:00100000:1.0:1789583667.757679:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251776 00000100:00100000:1.0:1789583667.757706:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789583667.757713:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332251776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757747:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332251776:12345-0@lo:400:kworker.0 Request processed in 35us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.757753:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789583667.757770:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332251008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583667.757794:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583667.757866:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332251520:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583667.757902:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789583667.757907:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332251392:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757927:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789583667.757956:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b541c5c380 x1876514332251776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583667.757967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332251776:0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.757981:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251520 00000100:00100000:1.0:1789583667.757992:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251520 00000100:00100000:1.0:1789583667.758016:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789583667.758021:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332251520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.758057:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332251520:12345-0@lo:400:kworker.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.758062:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789583667.758077:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251392 00000100:00100000:1.0:1789583667.758080:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251392 00000100:00100000:1.0:1789583667.758111:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789583667.758118:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332251392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583667.758144:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332251392:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.758150:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789583667.758174:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332251392:0@lo:400:kworker.0 00010000:00080000:1.0:1789583667.758184:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b541c5ea00 x1876514332251520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583667.758192:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332251520:0@lo:400:kworker.0 00000100:00080000:1.0:1789583667.758222:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583667.758226:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583667.758229:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583667.758247:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251008 00000100:00100000:1.0:1789583667.758250:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251008 00000100:00100000:1.0:1789583667.758272:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789583667.758278:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332251008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583667.758302:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583667.758336:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332251008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.758350:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789583667.758374:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b541c5ce00 x1876514332251008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583667.758387:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332251008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583667.775040:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583667.775094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583667.776459:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313346944 00000100:00100000:3.0:1789583667.776471:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313346944 00000100:00100000:3.0:1789583667.776660:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 198 00000100:00100000:3.0:1789583667.776671:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313346944:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583667.776882:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313346944:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 212us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583667.776891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 198 00000100:00100000:1.0:1789583667.782017:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347072 00000100:00100000:1.0:1789583667.782032:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347072 00000100:00100000:1.0:1789583667.782122:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:1.0:1789583667.782133:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313347072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583667.782212:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313347072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 82us (7181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583667.782220:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00080000:2.0:1789583667.782648:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789583667.824026:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:0.0:1789583667.824036:0:6732:0:(genops.c:885:class_export_put()) final put ffff88b67525d000/768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:0.0:1789583667.824073:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67525d000/768b736a-7b4a-4614-9d07-b155a4183a8a for lustre-OST0000 00000020:00000080:0.0:1789583667.824123:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b67525b000 for lustre-OST0000 00000001:02000400:2.0:1789583667.869576:0:9264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00000100:00100000:0.0:1789583668.266285:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583668.266308:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332251904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583668.266376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583668.266439:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332251904 00000100:00100000:0.0:1789583668.266445:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332251904 00000100:00100000:0.0:1789583668.266487:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789583668.266496:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332251904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583668.266527:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583668.266570:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332251904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583668.266577:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789583668.266617:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e3800 x1876514332251904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583668.266650:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332251904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789583668.780320:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583669.802511:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789583670.468005:0:9362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:0.0:1789583670.823202:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583671.847115:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583672.871135:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b66dec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332252160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583672.871146:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332252032:0@lo:400:kworker.0 00000100:00100000:2.0:1789583672.872380:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583672.872436:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332252672:0@lo:400:kworker.0 00000100:00100000:2.0:1789583672.872466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583672.872493:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789583672.872713:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332252288:0@lo:400:kworker.0 00000100:00100000:2.0:1789583672.872739:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583672.872758:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332252800:0@lo:400:kworker.0 00000100:00100000:2.0:1789583672.872782:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789583672.873215:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583672.873779:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583672.873861:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332252544:0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.873893:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583672.873918:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789583672.873926:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332252416:0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.873951:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583672.873984:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252800 00000100:00100000:1.0:1789583672.873992:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252800 00000100:00100000:1.0:1789583672.874041:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252544 00000100:00100000:1.0:1789583672.874056:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252544 00000100:00100000:1.0:1789583672.874077:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789583672.874085:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332252800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874135:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332252800:12345-0@lo:400:kworker.0 Request processed in 51us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583672.874150:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789583672.874168:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789583672.874174:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332252544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874207:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332252544:12345-0@lo:400:kworker.0 Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583672.874213:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789583672.874229:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252672 00000100:00100000:1.0:1789583672.874233:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252672 00000100:00100000:1.0:1789583672.874255:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252288 00000100:00100000:1.0:1789583672.874258:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252288 00000100:00100000:1.0:1789583672.874268:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252416 00000100:00100000:1.0:1789583672.874270:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252416 00000100:00100000:1.0:1789583672.874282:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789583672.874287:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332252672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874315:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332252672:12345-0@lo:400:kworker.0 Request processed in 27us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583672.874320:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789583672.874330:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789583672.874335:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332252288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874359:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332252288:12345-0@lo:400:kworker.0 Request processed in 24us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583672.874364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789583672.874374:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789583672.874380:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332252416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874403:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332252416:12345-0@lo:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583672.874420:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789583672.874464:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332252416:0@lo:400:kworker.0 00010000:00080000:1.0:1789583672.874477:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b541c5c380 x1876514332252544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583672.874488:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332252544:0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874518:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332252288:0@lo:400:kworker.0 00010000:00080000:1.0:1789583672.874528:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b541c5e300 x1876514332252800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583672.874538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332252800:0@lo:400:kworker.0 00000100:00100000:1.0:1789583672.874549:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332252672:0@lo:400:kworker.0 00000100:00100000:0.0:1789583672.874924:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252160 00000100:00100000:0.0:1789583672.874930:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252160 00000100:00100000:0.0:1789583672.874959:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789583672.874966:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332252160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583672.874993:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583672.875036:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332252160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583672.875042:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789583672.875095:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583672.875101:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583672.875103:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583672.876070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252032 00000100:00100000:3.0:1789583672.876078:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252032 00000100:00100000:3.0:1789583672.876161:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789583672.876169:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332252032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583672.876232:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332252032:12345-0@lo:400:kworker.0 Request processed in 65us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583672.876239:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789583672.876292:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332252032:0@lo:400:kworker.0 00010000:00080000:0.0:1789583672.882928:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b66dec2680 x1876514332252160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583672.882956:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b66dec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332252160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583672.892019:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583672.892299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583672.892377:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347328 00000100:00100000:0.0:1789583672.892389:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347328 00000100:00100000:0.0:1789583672.892467:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:0.0:1789583672.892477:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313347328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583672.892556:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313347328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 79us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583672.892564:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00080000:2.0:1789583672.892635:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583672.893237:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347200 00000100:00100000:3.0:1789583672.893245:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347200 00000100:00100000:3.0:1789583672.893295:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 200 00000100:00100000:3.0:1789583672.893302:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313347200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583672.893344:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313347200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 42us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583672.893351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 200 00000001:02000400:0.0:1789583673.162286:0:9459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00000100:00100000:2.0:1789583673.383066:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332252928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583673.383133:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583673.383237:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332252928 00000100:00100000:1.0:1789583673.383244:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332252928 00000100:00100000:1.0:1789583673.383292:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789583673.383301:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332252928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789583673.383333:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583673.394585:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332252928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11275us (11442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583673.394600:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789583673.394713:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e3800 x1876514332252928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583689 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583673.394736:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332252928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583673.895094:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583674.918968:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789583674.999724:0:9507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 14:34:33 EDT 2026 00010000:00010000:0.0:1789583675.942905:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583676.968126:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583677.991102:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332253056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583677.991180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583677.991244:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332253184:0@lo:400:kworker.0 00000100:00100000:3.0:1789583677.991270:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332253568:0@lo:400:kworker.0 00000100:00100000:0.0:1789583677.991287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583677.991317:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332253696:0@lo:400:kworker.0 00000100:00100000:0.0:1789583677.991340:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583677.991357:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789583677.991363:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332253312:0@lo:400:kworker.0 00000100:00100000:0.0:1789583677.991381:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583677.991398:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332253824:0@lo:400:kworker.0 00000100:00100000:0.0:1789583677.991419:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789583677.991437:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583677.991454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253184 00000100:00100000:3.0:1789583677.991462:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253184 00000100:00100000:0.0:1789583677.991464:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253696 00000100:00100000:0.0:1789583677.991470:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253696 00000100:00100000:0.0:1789583677.991511:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253312 00000100:00100000:0.0:1789583677.991515:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253312 00000100:00100000:0.0:1789583677.991538:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789583677.991546:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332253696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583677.991588:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789583677.991601:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332253696:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583677.991602:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332253184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583677.991616:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789583677.991636:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789583677.991643:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332253312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583677.991651:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332253184:12345-0@lo:400:kworker.0 Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583677.991659:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789583677.991688:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332253312:12345-0@lo:400:kworker.0 Request processed in 45us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583677.991696:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789583677.991702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583677.991727:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253824 00000100:00100000:3.0:1789583677.991729:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583677.991733:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253824 00000100:00100000:3.0:1789583677.991738:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332253440:0@lo:400:kworker.0 00000100:00100000:0.0:1789583677.991761:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253568 00000100:00100000:0.0:1789583677.991766:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253568 00000100:00100000:3.0:1789583677.991768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583677.991801:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789583677.991858:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253056 00000100:00100000:1.0:1789583677.991864:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253056 00000100:00100000:1.0:1789583677.991893:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789583677.991900:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332253056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583677.991941:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583677.991995:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332253056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583677.992001:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789583677.992050:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253440 00000100:00100000:1.0:1789583677.992054:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253440 00000100:00100000:1.0:1789583677.992078:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789583677.992084:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332253440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583677.992113:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332253440:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583677.992119:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789583677.992139:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583677.992143:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583677.992146:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583677.992310:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583677.992342:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332253824:12345-0@lo:400:kworker.0 Request processed in 36us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583677.994283:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789583677.994297:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789583677.994430:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789583677.994768:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332253312:0@lo:400:kworker.0 00010000:00080000:1.0:1789583677.994786:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e3480 x1876514332253824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583677.994796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332253824:0@lo:400:kworker.0 00000100:00100000:1.0:1789583677.994828:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332253184:0@lo:400:kworker.0 00000100:00100000:1.0:1789583677.994842:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332253696:0@lo:400:kworker.0 00000100:00100000:1.0:1789583677.994877:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332253568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583677.994945:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332253568:12345-0@lo:400:kworker.0 Request processed in 507us (3247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583677.994953:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789583677.995285:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789583677.995996:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332253440:0@lo:400:kworker.0 00010000:00080000:3.0:1789583677.996039:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e0a80 x1876514332253568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583677.996049:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332253568:0@lo:400:kworker.0 00010000:00080000:3.0:1789583677.996061:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e1f80 x1876514332253056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583677.996075:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332253056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583678.010138:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583678.010206:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583678.010291:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347456 00000100:00100000:2.0:1789583678.010300:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347456 00000100:00100000:2.0:1789583678.010351:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:2.0:1789583678.010360:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2360:x1876514313347456:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583678.010430:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+10:2360:x1876514313347456:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583678.010437:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:0.0:1789583678.011458:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347584 00000100:00100000:0.0:1789583678.011467:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347584 00000100:00100000:0.0:1789583678.011714:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583678.011724:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313347584:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583678.011787:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313347584:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 65us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583678.011821:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00080000:1.0:1789583678.011828:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583678.503970:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332253952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583678.504051:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583678.504185:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332253952 00000100:00100000:2.0:1789583678.504193:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332253952 00000100:00100000:2.0:1789583678.504243:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789583678.504252:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332253952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583678.504285:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583678.504344:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332253952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583678.504369:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789583678.504855:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e1f80 x1876514332253952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583694 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583678.504874:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332253952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583679.014976:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583680.043228:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583681.063026:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583682.086986:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583683.111052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332254336:0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.111119:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583683.111176:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789583683.111182:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332254208:0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.111202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583683.111218:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332254720:0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.111241:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583683.111272:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254336 00000100:00100000:0.0:1789583683.111279:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254336 00000100:00100000:0.0:1789583683.111325:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254208 00000100:00100000:0.0:1789583683.111329:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254208 00000100:00100000:0.0:1789583683.111351:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789583683.111375:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332254336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.111422:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332254336:12345-0@lo:400:kworker.0 Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583683.111429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789583683.111444:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789583683.111450:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332254208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.111472:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332254208:12345-0@lo:400:kworker.0 Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583683.111477:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789583683.111516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332254208:0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.111526:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332254336:0@lo:400:kworker.0 00010000:00010000:0.0:1789583683.111577:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583683.111634:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332254464:0@lo:400:kworker.0 00000100:00100000:2.0:1789583683.111663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583683.111689:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789583683.111695:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332254080:0@lo:400:kworker.0 00000100:00100000:2.0:1789583683.111720:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583683.111742:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332254592:0@lo:400:kworker.0 00000100:00100000:2.0:1789583683.111760:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583683.111782:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254080 00000100:00100000:2.0:1789583683.111786:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254080 00000100:00100000:2.0:1789583683.111835:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789583683.111842:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332254080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583683.111874:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332254080:12345-0@lo:400:kworker.0 Request processed in 33us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583683.111881:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789583683.111914:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332254080:0@lo:400:kworker.0 00000100:00100000:1.0:1789583683.111997:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254720 00000100:00100000:1.0:1789583683.112002:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254720 00000100:00100000:1.0:1789583683.112039:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254464 00000100:00100000:1.0:1789583683.112042:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254464 00000100:00100000:1.0:1789583683.112061:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789583683.112067:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332254720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583683.112104:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332254720:12345-0@lo:400:kworker.0 Request processed in 38us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583683.112110:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789583683.112121:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789583683.112127:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332254464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583683.112157:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332254464:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583683.112161:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789583683.112175:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583683.112178:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583683.112180:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789583683.112209:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e2d80 x1876514332254464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583683.112221:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332254464:0@lo:400:kworker.0 00010000:00080000:1.0:1789583683.112242:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e3480 x1876514332254720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583683.112263:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332254720:0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.112357:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254592 00000100:00100000:0.0:1789583683.112361:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254592 00000100:00100000:0.0:1789583683.112440:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789583683.112447:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332254592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583683.112480:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332254592:12345-0@lo:400:kworker.0 Request processed in 34us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583683.112485:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789583683.112522:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583683.112539:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332254592:0@lo:400:kworker.0 00000100:00100000:1.0:1789583683.115537:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583683.115559:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332254848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583683.115620:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583683.115661:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254848 00000100:00100000:1.0:1789583683.115667:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254848 00000100:00100000:1.0:1789583683.115707:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789583683.115715:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332254848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583683.115743:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583683.115783:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332254848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583683.115790:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789583683.115860:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b541c5e300 x1876514332254848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583683.115877:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332254848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583683.129103:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583683.129210:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583683.129242:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347712 00000100:00100000:1.0:1789583683.129250:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347712 00000100:00100000:1.0:1789583683.129302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:1.0:1789583683.129312:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313347712:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583683.129375:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313347712:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583683.129394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:0.0:1789583683.131002:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347840 00000100:00100000:0.0:1789583683.131014:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347840 00000100:00100000:0.0:1789583683.131078:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:0.0:1789583683.131086:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313347840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583683.131144:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313347840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 60us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583683.131162:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00080000:0.0:1789583683.131186:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583683.626700:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789583683.626722:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6488b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332254976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583683.626787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583683.626930:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332254976 00000100:00100000:0.0:1789583683.626938:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332254976 00000100:00100000:0.0:1789583683.627003:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789583683.627014:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332254976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583683.627049:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583683.627102:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332254976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583683.627109:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789583683.627130:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6488b6680 x1876514332254976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583683.627148:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6488b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332254976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583684.136128:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583685.158991:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583686.184896:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583687.206997:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583688.230943:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583688.231412:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332255232:0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.231477:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583688.231532:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332255744:0@lo:400:kworker.0 00000100:00100000:0.0:1789583688.231557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332255488:0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.231564:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583688.231598:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583688.231600:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789583688.231608:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332255360:0@lo:400:kworker.0 00000100:00100000:0.0:1789583688.231627:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789583688.231637:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b541c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332255104:0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.231669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583688.231692:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332255872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583688.231717:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583688.231752:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255232 00000100:00100000:1.0:1789583688.231760:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255232 00000100:00100000:1.0:1789583688.231822:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255360 00000100:00100000:1.0:1789583688.231826:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255360 00000100:00100000:1.0:1789583688.231865:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789583688.231878:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332255232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583688.231879:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583688.231912:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332255616:0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.231950:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332255232:12345-0@lo:400:kworker.0 Request processed in 75us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.231959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583688.231963:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789583688.231985:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255616 00000100:00100000:1.0:1789583688.231989:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255616 00000100:00100000:0.0:1789583688.231993:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789583688.232008:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332255360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.232014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789583688.232025:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332255616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.232077:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332255616:12345-0@lo:400:kworker.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583688.232083:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789583688.232115:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255744 00000100:00100000:1.0:1789583688.232118:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255744 00000100:00100000:0.0:1789583688.232126:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332255360:12345-0@lo:400:kworker.0 Request processed in 46us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.232137:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789583688.232144:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255488 00000100:00100000:1.0:1789583688.232148:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255488 00000100:00100000:1.0:1789583688.232303:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789583688.232306:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255104 00000100:00100000:1.0:1789583688.232313:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332255744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583688.232319:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255104 00000100:00100000:0.0:1789583688.232357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789583688.232365:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332255744:12345-0@lo:400:kworker.0 Request processed in 54us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583688.232373:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789583688.232380:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332255104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.232388:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789583688.232398:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332255488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583688.232423:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332255104:12345-0@lo:400:kworker.0 Request processed in 59us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.232431:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789583688.232438:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332255488:12345-0@lo:400:kworker.0 Request processed in 42us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583688.232446:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789583688.232480:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332255872 00000100:00100000:1.0:1789583688.232484:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332255872 00000100:00080000:0.0:1789583688.232500:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789583688.232506:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789583688.232510:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583688.232515:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789583688.232523:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332255872:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583688.232543:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332255360:0@lo:400:kworker.0 00002000:00000024:1.0:1789583688.232551:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583688.232560:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332255232:0@lo:400:kworker.0 00010000:00080000:0.0:1789583688.232579:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880000 x1876514332255744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583688.232592:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332255872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.232593:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332255744:0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.232606:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789583688.232633:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e2300 x1876514332255872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583688.232647:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b541c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332255104:0@lo:400:kworker.0 00000100:00100000:1.0:1789583688.232669:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332255616:0@lo:400:kworker.0 00010000:00080000:1.0:1789583688.232678:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880380 x1876514332255488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583688.232687:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332255488:0@lo:400:kworker.0 00000100:00100000:0.0:1789583688.232966:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332255872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583688.244732:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583688.244788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583688.244959:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313347968 00000100:00100000:0.0:1789583688.244968:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313347968 00000100:00100000:0.0:1789583688.245026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 206 00000100:00100000:0.0:1789583688.245036:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313347968:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583688.245117:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2358:x1876514313347968:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.245125:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 206 00000100:00100000:1.0:1789583688.245616:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348096 00000100:00100000:1.0:1789583688.245622:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348096 00000100:00100000:1.0:1789583688.245676:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:1.0:1789583688.245684:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313348096:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583688.245729:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313348096:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 46us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583688.245736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00080000:0.0:1789583688.246038:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1789583688.410355:0:10139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:34:46 (1789583686) === 00000100:00100000:1.0:1789583688.743410:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6488b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332256000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583688.743482:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583688.743713:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256000 00000100:00100000:3.0:1789583688.743722:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256000 00000100:00100000:3.0:1789583688.743773:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789583688.743783:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332256000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583688.743832:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583688.743882:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332256000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583688.743889:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789583688.743920:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6488b4e00 x1876514332256000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583688.743949:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6488b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332256000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583688.931802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583688.933542:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348224 00000100:00100000:0.0:1789583688.933556:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348224 00000100:00100000:0.0:1789583688.933634:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 207 00000100:00100000:0.0:1789583688.933644:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+10:8139:x1876514313348224:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789583688.933660:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583688.933678:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cb400/0x6d3e73d72c6e2ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6317 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583688.933716:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cb400/0x6d3e73d72c6e2ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6317 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583688.933727:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cb400/0x6d3e73d72c6e2ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6317 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583688.933736:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cb400, rc 0) 00000100:00100000:0.0:1789583688.933832:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+11:8139:x1876514313348224:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 162us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.933839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 207 00000100:00100000:3.0:1789583688.940993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583688.941101:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348352 00000100:00100000:2.0:1789583688.941112:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348352 00000100:00100000:2.0:1789583688.941183:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 208 00000100:00100000:2.0:1789583688.941195:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+11:8139:x1876514313348352:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789583688.941497:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+11:8139:x1876514313348352:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 303us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583688.941505:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 208 00000100:00100000:3.0:1789583688.946518:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583688.946668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348480 00000100:00100000:2.0:1789583688.946678:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348480 00000100:00100000:2.0:1789583688.946728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 209 00000100:00100000:2.0:1789583688.946736:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+11:8139:x1876514313348480:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789583688.946967:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+11:8139:x1876514313348480:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 230us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583688.946975:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 209 00000100:00100000:3.0:1789583688.954527:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583688.954836:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348608 00000100:00100000:0.0:1789583688.954846:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348608 00000100:00100000:0.0:1789583688.954911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 210 00000100:00100000:0.0:1789583688.954922:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+11:8142:x1876514313348608:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789583688.955199:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+11:8142:x1876514313348608:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 279us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583688.955214:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 210 00000100:00100000:3.0:1789583688.983151:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583688.983262:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348736 00000100:00100000:2.0:1789583688.983272:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348736 00000100:00100000:2.0:1789583688.983329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:2.0:1789583688.983339:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+11:8142:x1876514313348736:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789583688.983633:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+11:8142:x1876514313348736:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 294us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583688.983641:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:3.0:1789583688.988947:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583688.989265:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348864 00000100:00100000:2.0:1789583688.989275:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348864 00000100:00100000:2.0:1789583688.989330:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:2.0:1789583688.989340:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+11:8139:x1876514313348864:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789583688.989356:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583688.989372:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e2ece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6341 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583688.989423:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e2ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6341 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583688.989434:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e2ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6341 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583688.989443:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1e00, rc 0) 00000100:00100000:2.0:1789583688.989501:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:8139:x1876514313348864:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 162us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583688.989508:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:3.0:1789583688.996431:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583689.000288:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313348992 00000100:00100000:0.0:1789583689.000304:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313348992 00000100:00100000:0.0:1789583689.000384:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:0.0:1789583689.000393:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+12:8139:x1876514313348992:12345-192.168.203.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789583689.000417:0:5843:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789583689.000441:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789583689.000445:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789583689.000447:0:5843:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789583689.000449:0:5843:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789583689.004752:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+12:8139:x1876514313348992:12345-192.168.203.46@tcp:256:mount.lustre.0 Request processed in 4348us (8321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583689.004766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:3.0:1789583689.009959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583689.010055:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349120 00000100:00100000:0.0:1789583689.010063:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349120 00000100:00100000:0.0:1789583689.010122:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 214 00000100:00100000:0.0:1789583689.010132:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:8139:x1876514313349120:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789583689.010147:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583689.010165:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6348 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583689.010193:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583689.010203:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583689.010230:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cbc00, rc 0) 00000100:00100000:0.0:1789583689.010296:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:8139:x1876514313349120:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 166us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583689.010302:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 214 00000100:00100000:3.0:1789583689.016469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583689.016669:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349248 00000100:00100000:0.0:1789583689.016684:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349248 00000100:00100000:0.0:1789583689.016752:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 215 00000100:00100000:0.0:1789583689.016762:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:8139:x1876514313349248:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789583689.017575:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:8139:x1876514313349248:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 747us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583689.017585:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 215 00000100:00100000:3.0:1789583689.021869:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583689.022104:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349376 00000100:00100000:2.0:1789583689.022119:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349376 00000100:00100000:2.0:1789583689.022214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 216 00000100:00100000:2.0:1789583689.022229:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:8139:x1876514313349376:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789583689.022967:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:8139:x1876514313349376:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 738us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583689.022977:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 216 00000100:00100000:3.0:1789583689.026191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583689.030491:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349504 00000100:00100000:1.0:1789583689.030504:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349504 00000100:00100000:1.0:1789583689.031004:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 217 00000100:00100000:1.0:1789583689.031015:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:8147:x1876514313349504:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583689.031294:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:8147:x1876514313349504:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 280us (5111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583689.031302:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 217 00000100:00100000:3.0:1789583689.038066:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583689.038274:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349632 00000100:00100000:1.0:1789583689.038284:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349632 00000100:00100000:1.0:1789583689.038423:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 218 00000100:00100000:1.0:1789583689.038457:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:8147:x1876514313349632:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583689.039244:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:8147:x1876514313349632:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 353us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583689.039256:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 218 00000100:00100000:3.0:1789583689.047617:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583689.048617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583689.049209:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349760 00000100:00100000:0.0:1789583689.049219:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349760 00000100:00100000:0.0:1789583689.049265:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350144 00000100:00100000:0.0:1789583689.049269:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350144 00000100:00100000:0.0:1789583689.049449:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:0.0:1789583689.049460:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313350144:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583689.049534:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313350144:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 77us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583689.049541:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:0.0:1789583689.049558:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583689.049563:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1876514313349760:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789583689.049585:0:5850:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7452e9e9-4caa-4b5a-b84c-d7e502425f35@192.168.203.46@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1789583689.049620:0:5850:0:(genops.c:1384:class_connect()) connect: client 7452e9e9-4caa-4b5a-b84c-d7e502425f35, cookie 0x6d3e73d72c6e2edc 00000004:00100000:0.0:1789583689.049664:0:5850:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789583689.049967:0:5850:0:(import.c:65:import_set_state_nolock()) ffff88b6620e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583689.050003:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:2357:x1876514313349760:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 438us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583689.050010:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:3.0:1789583689.055995:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583689.056125:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583689.056478:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313349888 00000100:00100000:2.0:1789583689.056488:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313349888 00000100:00100000:2.0:1789583689.056563:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350016 00000100:00100000:2.0:1789583689.056566:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350016 00000100:00100000:2.0:1789583689.056601:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789583689.056611:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+7:0:x1876514313349888:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789583689.056653:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789583689.056734:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+7:0:x1876514313349888:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 125us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583689.056761:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789583689.056781:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789583689.056787:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:8139:x1876514313350016:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789583689.056798:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1789583689.057147:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583689.057368:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:8139:x1876514313350016:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 579us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583689.057375:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:3.0:1789583689.059412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583689.059489:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350272 00000100:00100000:1.0:1789583689.059500:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350272 00000100:00100000:1.0:1789583689.059566:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:1.0:1789583689.059575:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:8139:x1876514313350272:12345-192.168.203.46@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789583689.060188:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:8139:x1876514313350272:12345-192.168.203.46@tcp:40:mount.lustre.0 Request processed in 612us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583689.060197:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:0.0:1789583689.068131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583689.068169:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583689.068205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583689.068345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350656 00000100:00100000:3.0:1789583689.068355:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350656 00000100:00100000:3.0:1789583689.068417:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:3.0:1789583689.068427:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:8139:x1876514313350656:12345-192.168.203.46@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789583689.068500:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789583689.068974:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:8139:x1876514313350656:12345-192.168.203.46@tcp:33:mount.lustre.0 Request processed in 548us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583689.068983:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:2.0:1789583689.070080:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350400 00000100:00100000:2.0:1789583689.070089:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350400 00000100:00100000:2.0:1789583689.070130:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350528 00000100:00100000:2.0:1789583689.070134:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350528 00000100:00100000:2.0:1789583689.070159:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789583689.070167:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1876514313350400:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789583689.070193:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7452e9e9-4caa-4b5a-b84c-d7e502425f35@192.168.203.46@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:2.0:1789583689.070226:0:6705:0:(genops.c:1384:class_connect()) connect: client 7452e9e9-4caa-4b5a-b84c-d7e502425f35, cookie 0x6d3e73d72c6e2ee3 00002000:00100000:2.0:1789583689.070300:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7452e9e9-4caa-4b5a-b84c-d7e502425f35/ffff88b67c4a7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789583689.070312:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789583689.070713:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:1.0:1789583689.070720:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876514313350528:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789583689.070740:0:6702:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7452e9e9-4caa-4b5a-b84c-d7e502425f35@192.168.203.46@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1789583689.070759:0:6702:0:(genops.c:1384:class_connect()) connect: client 7452e9e9-4caa-4b5a-b84c-d7e502425f35, cookie 0x6d3e73d72c6e2eea 00002000:00100000:1.0:1789583689.070764:0:6702:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7452e9e9-4caa-4b5a-b84c-d7e502425f35/ffff88b67525e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789583689.070770:0:6702:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789583689.070977:0:6702:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789583689.071007:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b67525b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789583689.071062:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:2357:x1876514313350528:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 341us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583689.071069:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00002000:00080000:2.0:1789583689.072718:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789583689.072754:0:6705:0:(import.c:65:import_set_state_nolock()) ffff88b67c4a2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583689.072833:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:2357:x1876514313350400:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 2664us (4710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583689.072843:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00010000:00010000:1.0:1789583689.255175:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583690.279931:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583691.306196:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583692.327021:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583692.394753:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000001:00100000:3.0:1789583692.397527:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000100:00100000:1.0:1789583693.351035:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332256128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583693.351118:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583693.351191:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256128 00000100:00100000:0.0:1789583693.351201:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256128 00000100:00080000:1.0:1789583693.351243:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583693.351268:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789583693.351280:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332256128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583693.351315:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583693.351377:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332256128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583693.351384:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789583693.351468:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752d8700 x1876514332256128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583693.351486:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332256128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789583693.351733:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583693.351835:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332256256:0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.351872:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583693.351915:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332256768:0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.351943:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583693.351964:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583693.351967:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332256512:0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.351972:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332256384:0@lo:400:kworker.0 00000100:00100000:1.0:1789583693.352062:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256768 00000100:00100000:1.0:1789583693.352067:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256768 00000100:00100000:1.0:1789583693.352118:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789583693.352177:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256256 00000100:00100000:2.0:1789583693.352188:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256256 00000100:00100000:2.0:1789583693.352217:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789583693.352224:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332256256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583693.354197:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332256768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.359567:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583693.359653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256384 00000100:00100000:0.0:1789583693.359662:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256384 00000100:00100000:0.0:1789583693.359740:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789583693.359750:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332256384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.359824:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332256384:12345-0@lo:400:kworker.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583693.359831:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789583693.359873:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332256384:0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.360226:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332256640:0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.360259:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583693.360289:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256640 00000100:00100000:0.0:1789583693.360293:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256640 00000100:00100000:0.0:1789583693.360320:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583693.360327:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583693.360363:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332256640:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583693.360370:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583693.360471:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332256640:0@lo:400:kworker.0 00000100:00080000:0.0:1789583693.360503:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789583693.360508:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583693.360656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583693.360700:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256512 00000100:00100000:3.0:1789583693.360704:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256512 00000100:00100000:3.0:1789583693.361129:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789583693.361226:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332256256:12345-0@lo:400:kworker.0 Request processed in 8999us (9350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583693.361237:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789583693.361272:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67badf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332256256:0@lo:400:kworker.0 00000100:00080000:2.0:1789583693.361315:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583693.361326:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332256512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583693.361362:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332256512:12345-0@lo:400:kworker.0 Request processed in 225us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583693.361369:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789583693.361398:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332256512:0@lo:400:kworker.0 00000100:00100000:1.0:1789583693.363776:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332256768:12345-0@lo:400:kworker.0 Request processed in 11642us (11824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583693.363788:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789583693.363861:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b1d1180 x1876514332256768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583693.363876:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332256768:0@lo:400:kworker.0 00000001:00100000:1.0:1789583693.462328:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000100:00100000:1.0:1789583693.863156:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6488b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332256896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583693.863236:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583693.863309:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332256896 00000100:00100000:1.0:1789583693.863317:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332256896 00000100:00100000:1.0:1789583693.863360:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789583693.863368:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332256896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789583693.863402:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583693.863454:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332256896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583693.863461:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789583693.863503:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6488b4000 x1876514332256896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583693.863523:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6488b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332256896:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789583694.299871:0:10336:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789583694.375157:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583694.395315:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583694.395355:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583694.395387:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583694.395413:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583694.395447:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583694.395474:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351296 00000100:00100000:3.0:1789583694.395482:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351296 00000100:00100000:3.0:1789583694.395545:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351168 00000100:00100000:3.0:1789583694.395548:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351168 00000100:00100000:3.0:1789583694.395569:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789583694.395581:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313351296:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583694.395643:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313351296:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 66us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583694.395651:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789583694.395666:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:3.0:1789583694.395672:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313351168:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583694.395695:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313351168:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583694.395701:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00080000:3.0:1789583694.395718:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789583694.395721:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583694.395796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350784 00000100:00100000:1.0:1789583694.395800:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350784 00000100:00100000:1.0:1789583694.395926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:1.0:1789583694.395933:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313350784:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583694.395960:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313350784:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583694.395966:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:0.0:1789583694.396107:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351040 00000100:00100000:0.0:1789583694.396112:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351040 00000100:00100000:0.0:1789583694.396153:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313350912 00000100:00100000:0.0:1789583694.396156:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313350912 00000100:00100000:0.0:1789583694.396176:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:0.0:1789583694.396183:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313351040:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583694.396216:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313351040:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 33us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583694.396308:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:0.0:1789583694.396327:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789583694.396333:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313350912:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583694.396359:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313350912:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583694.396364:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00080000:1.0:1789583694.397219:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789583695.399102:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583696.424029:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583697.454256:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583698.472247:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332257152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583698.472272:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332257408:0@lo:400:kworker.0 00010000:00010000:0.0:1789583698.472750:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583698.473586:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332257024:0@lo:400:kworker.0 00000100:00100000:0.0:1789583698.474058:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332257280:0@lo:400:kworker.0 00000100:00100000:1.0:1789583698.479511:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583698.479630:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257408 00000100:00100000:1.0:1789583698.479639:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257408 00000100:00100000:1.0:1789583698.479694:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789583698.479705:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332257408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583698.479766:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332257408:12345-0@lo:400:kworker.0 Request processed in 64us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583698.479772:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789583698.479821:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583698.479868:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332257408:0@lo:400:kworker.0 00000100:00100000:2.0:1789583698.480702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583698.480768:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332257664:0@lo:400:kworker.0 00000100:00100000:2.0:1789583698.480831:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583698.480909:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257152 00000100:00100000:1.0:1789583698.480916:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257152 00000100:00100000:1.0:1789583698.480965:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789583698.480975:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332257152:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583698.481880:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257664 00000100:00100000:2.0:1789583698.481888:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257664 00000100:00100000:2.0:1789583698.481933:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789583698.481941:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332257664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583698.481996:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332257664:12345-0@lo:400:kworker.0 Request processed in 56us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583698.482003:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789583698.482047:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332257664:0@lo:400:kworker.0 00000100:00080000:2.0:1789583698.482118:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583698.482122:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1789583698.482150:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583698.482262:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332257152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1289us (1562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583698.482268:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789583698.482297:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b1d1f80 x1876514332257152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583698.482312:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332257152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583698.482377:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583698.482421:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332257536:0@lo:400:kworker.0 00000100:00100000:3.0:1789583698.482464:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583698.482496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257024 00000100:00100000:3.0:1789583698.482500:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257024 00000100:00100000:3.0:1789583698.482539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789583698.482546:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332257024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583698.482593:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332257024:12345-0@lo:400:kworker.0 Request processed in 48us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583698.482606:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789583698.482634:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257536 00000100:00100000:3.0:1789583698.482637:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257536 00000100:00100000:3.0:1789583698.482658:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789583698.482664:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332257536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583698.482691:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332257536:12345-0@lo:400:kworker.0 Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583698.482697:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789583698.482721:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332257024:0@lo:400:kworker.0 00010000:00080000:3.0:1789583698.482733:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752d8000 x1876514332257536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583698.482742:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332257536:0@lo:400:kworker.0 00000100:00100000:0.0:1789583698.487719:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583698.487921:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332257792:0@lo:400:kworker.0 00000100:00100000:0.0:1789583698.487971:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583698.488117:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257280 00000100:00100000:1.0:1789583698.488126:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257280 00000100:00100000:1.0:1789583698.488215:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789583698.488224:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332257280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583698.488290:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332257280:12345-0@lo:400:kworker.0 Request processed in 68us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583698.488297:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789583698.488359:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257792 00000100:00100000:2.0:1789583698.488365:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257792 00000100:00100000:3.0:1789583698.488400:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332257280:0@lo:400:kworker.0 00000100:00080000:3.0:1789583698.488431:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583698.488935:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789583698.488945:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332257792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583698.488995:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332257792:12345-0@lo:400:kworker.0 Request processed in 54us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583698.489001:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789583698.489035:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752d9880 x1876514332257792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583698.489059:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332257792:0@lo:400:kworker.0 00000100:00100000:2.0:1789583698.983169:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583698.983201:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6488b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332257920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583698.983295:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583698.983456:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332257920 00000100:00100000:3.0:1789583698.983466:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332257920 00000100:00100000:3.0:1789583698.983661:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789583698.983675:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332257920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583698.983721:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583698.983845:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332257920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583698.983863:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789583698.991153:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6488b6d80 x1876514332257920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583698.991195:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6488b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332257920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583699.496558:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583699.514906:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583699.514943:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583699.514981:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583699.514998:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583699.515025:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583699.515061:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351552 00000100:00100000:2.0:1789583699.515070:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351552 00000100:00100000:2.0:1789583699.515120:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351680 00000100:00100000:2.0:1789583699.515123:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351680 00000100:00100000:2.0:1789583699.515148:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:2.0:1789583699.515158:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313351552:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583699.515234:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2360:x1876514313351552:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 78us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583699.515241:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:2.0:1789583699.515259:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583699.515265:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313351680:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583699.515293:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313351680:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583699.515299:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:3.0:1789583699.515617:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351808 00000100:00100000:3.0:1789583699.515623:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351808 00000100:00100000:3.0:1789583699.515779:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351936 00000100:00100000:3.0:1789583699.515794:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351936 00000100:00100000:3.0:1789583699.515841:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:3.0:1789583699.515858:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313351808:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583699.515895:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313351808:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 47us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583699.515902:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:3.0:1789583699.515916:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789583699.515923:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313351936:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583699.516058:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313351936:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 135us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583699.516065:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789583699.516084:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313351424 00000100:00100000:3.0:1789583699.516087:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313351424 00000100:00100000:3.0:1789583699.516344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:3.0:1789583699.516352:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2360:x1876514313351424:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583699.516379:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2360:x1876514313351424:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 28us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583699.516385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00080000:3.0:1789583699.522693:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583699.522703:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789583699.522707:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789583700.519071:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583701.542909:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583702.568083:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583703.591247:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332258048:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.591317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583703.591408:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258048 00000100:00100000:1.0:1789583703.591426:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258048 00000100:00100000:1.0:1789583703.591476:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789583703.591486:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332258048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.591780:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332258560:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.591839:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583703.591955:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332258048:12345-0@lo:400:kworker.0 Request processed in 470us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583703.591963:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789583703.592073:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332258176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583703.592104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583703.594146:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258176 00000100:00100000:1.0:1789583703.594160:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258176 00000100:00100000:1.0:1789583703.594220:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789583703.594231:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332258176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583703.594265:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583703.594339:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332258176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583703.594346:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789583703.594386:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b1d1c00 x1876514332258176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583703.594405:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332258176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583703.594775:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332258048:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.594830:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258560 00000100:00100000:3.0:1789583703.594835:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258560 00000100:00100000:3.0:1789583703.594876:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789583703.594883:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332258560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.594925:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332258560:12345-0@lo:400:kworker.0 Request processed in 43us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583703.594932:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789583703.594948:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789583703.595003:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648882680 x1876514332258560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583703.595013:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332258560:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.595050:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332258304:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.595080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583703.595103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583703.595109:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332258432:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.595764:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789583703.596744:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583703.596838:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332258688:0@lo:400:kworker.0 00000100:00100000:0.0:1789583703.596885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583703.599284:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258304 00000100:00100000:1.0:1789583703.599297:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258304 00000100:00100000:0.0:1789583703.599304:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258432 00000100:00100000:0.0:1789583703.599312:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258432 00000100:00100000:0.0:1789583703.599354:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258688 00000100:00100000:0.0:1789583703.599357:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258688 00000100:00100000:0.0:1789583703.599380:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789583703.599389:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332258304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583703.599427:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789583703.599437:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332258432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583703.599473:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332258304:12345-0@lo:400:kworker.0 Request processed in 84us (4390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583703.599500:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789583703.599520:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789583703.599527:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332258688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583703.599839:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332258688:12345-0@lo:400:kworker.0 Request processed in 312us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583703.599846:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789583703.599882:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332258432:12345-0@lo:400:kworker.0 Request processed in 446us (4119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583703.599890:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789583703.599893:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332258688:0@lo:400:kworker.0 00000100:00100000:1.0:1789583703.601546:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789583703.601570:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332258816:0@lo:400:kworker.0 00000100:00100000:1.0:1789583703.601631:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583703.602548:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258816 00000100:00100000:0.0:1789583703.602559:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258816 00000100:00100000:0.0:1789583703.602616:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789583703.602624:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332258816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583703.602690:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332258816:12345-0@lo:400:kworker.0 Request processed in 67us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583703.602697:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789583703.602743:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648882680 x1876514332258816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583703.602757:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332258816:0@lo:400:kworker.0 00000100:00080000:3.0:1789583703.604724:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583703.604734:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583703.604777:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332258432:0@lo:400:kworker.0 00000100:00100000:3.0:1789583703.604792:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332258304:0@lo:400:kworker.0 00000100:00100000:3.0:1789583704.103024:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583704.103047:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6488b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332258944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583704.103114:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583704.103141:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332258944 00000100:00100000:2.0:1789583704.103149:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332258944 00000100:00100000:2.0:1789583704.103194:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789583704.103204:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332258944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583704.103241:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583704.103319:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332258944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583704.103326:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789583704.103455:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6488b4000 x1876514332258944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583704.103490:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6488b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332258944:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583704.614970:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583704.630622:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583704.630659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583704.630748:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352192 00000100:00100000:3.0:1789583704.630749:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352448 00000100:00100000:3.0:1789583704.630759:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352448 00000100:00100000:0.0:1789583704.630760:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352192 00000100:00100000:2.0:1789583704.630798:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583704.630876:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:0.0:1789583704.630887:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313352192:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583704.630912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352064 00000100:00100000:2.0:1789583704.630918:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352064 00000100:00100000:2.0:1789583704.630951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 224 00000100:00100000:0.0:1789583704.630961:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313352192:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 76us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583704.630971:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313352064:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583704.630985:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:0.0:1789583704.630989:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:3.0:1789583704.630998:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313352448:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583704.631004:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313352064:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 45us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583704.631010:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 224 00000100:00100000:3.0:1789583704.631025:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313352448:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583704.631031:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00080000:1.0:1789583704.631691:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583704.631697:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583704.635022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583704.635092:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583704.635222:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352576 00000100:00100000:0.0:1789583704.635237:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352576 00000100:00100000:2.0:1789583704.635371:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352320 00000100:00100000:2.0:1789583704.635377:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352320 00000100:00100000:0.0:1789583704.635441:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789583704.635452:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313352576:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583704.635545:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313352576:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 95us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583704.635552:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00080000:1.0:1789583704.636268:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583704.636346:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583704.637682:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:3.0:1789583704.637697:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313352320:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583704.637786:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313352320:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 94us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583704.637794:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00010000:00010000:2.0:1789583705.640430:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583706.664958:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583707.687997:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583708.711596:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583708.711674:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332259072:0@lo:400:kworker.0 00000100:00100000:0.0:1789583708.711680:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332259200:0@lo:400:kworker.0 00000100:00100000:1.0:1789583708.711702:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332259328:0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.711759:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583708.711760:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583708.711771:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332259456:0@lo:400:kworker.0 00000100:00100000:1.0:1789583708.711856:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583708.711891:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332259584:0@lo:400:kworker.0 00000100:00100000:0.0:1789583708.711891:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332259712:0@lo:400:kworker.0 00000100:00100000:1.0:1789583708.711904:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259072 00000100:00100000:1.0:1789583708.711912:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259072 00000100:00100000:0.0:1789583708.711930:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583708.711968:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259200 00000100:00100000:0.0:1789583708.711972:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259200 00000100:00100000:0.0:1789583708.712006:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789583708.712015:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332259200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.712060:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583708.712070:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332259200:12345-0@lo:400:kworker.0 Request processed in 56us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583708.712078:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789583708.712092:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259584 00000100:00100000:0.0:1789583708.712096:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259584 00000100:00100000:0.0:1789583708.712123:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789583708.712142:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332259584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583708.712183:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789583708.712192:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332259072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583708.716327:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332259584:12345-0@lo:400:kworker.0 Request processed in 4174us (4257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583708.716353:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789583708.716532:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332259584:0@lo:400:kworker.0 00000100:00080000:3.0:1789583708.716660:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583708.716689:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259456 00000100:00100000:3.0:1789583708.716697:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259456 00000100:00100000:3.0:1789583708.716770:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259712 00000100:00100000:3.0:1789583708.716773:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259712 00000100:00100000:3.0:1789583708.716825:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789583708.716835:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332259456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583708.716891:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789583708.716904:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332259456:12345-0@lo:400:kworker.0 Request processed in 68us (5045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583708.716904:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332259712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.716916:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789583708.716938:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583708.716942:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583708.716949:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674d5e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332259712:12345-0@lo:400:kworker.0 Request processed in 50us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583708.716956:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789583708.716970:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583708.717011:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259328 00000100:00100000:3.0:1789583708.717015:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259328 00000100:00100000:3.0:1789583708.717048:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789583708.717056:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332259328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.717093:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332259328:12345-0@lo:400:kworker.0 Request processed in 39us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583708.717098:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789583708.717110:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583708.717129:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752da680 x1876514332259712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583708.717139:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332259712:0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.717150:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332259200:0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.717172:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332259328:0@lo:400:kworker.0 00000100:00100000:3.0:1789583708.717251:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332259840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583708.717290:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583708.717315:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259840 00000100:00100000:3.0:1789583708.717319:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259840 00000100:00100000:3.0:1789583708.717346:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789583708.717353:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332259840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583708.717375:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583708.717407:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332259840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583708.717412:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789583708.717437:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67baafb80 x1876514332259840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583708.717451:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332259840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583708.717565:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332259072:12345-0@lo:400:kworker.0 Request processed in 5372us (5806us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583708.717575:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00080000:1.0:1789583708.717626:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752db480 x1876514332259456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583708.717638:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332259456:0@lo:400:kworker.0 00000100:00100000:1.0:1789583708.717679:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332259072:0@lo:400:kworker.0 00000100:00100000:2.0:1789583709.224589:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583709.224657:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332259968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583709.224735:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583709.224880:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332259968 00000100:00100000:0.0:1789583709.224887:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332259968 00000100:00100000:0.0:1789583709.224941:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789583709.224952:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332259968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583709.224987:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583709.225043:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332259968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583709.225050:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789583709.225128:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648881880 x1876514332259968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583709.225147:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332259968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789583709.735167:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583709.754584:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583709.754633:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583709.754670:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583709.754703:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583709.754750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583709.754779:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352960 00000100:00100000:2.0:1789583709.754790:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352960 00000100:00100000:3.0:1789583709.754992:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353088 00000100:00100000:3.0:1789583709.754998:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353088 00000100:00100000:3.0:1789583709.755048:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353216 00000100:00100000:3.0:1789583709.755053:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353216 00000100:00100000:2.0:1789583709.755053:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352832 00000100:00100000:2.0:1789583709.755060:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352832 00000100:00100000:2.0:1789583709.755087:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:3.0:1789583709.755097:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:2.0:1789583709.755100:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2359:x1876514313352960:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583709.755110:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2357:x1876514313353088:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:3.0:1789583709.755135:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2ee3 00000100:00080000:3.0:1789583709.755145:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b67c4a2000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789583709.755178:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2359:x1876514313352960:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 82us (544us total) trans 0 rc 0/0 00000001:00000004:3.0:1789583709.755179:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789583709.755187:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:2.0:1789583709.755227:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:2.0:1789583709.755236:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313352832:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583709.755340:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313352832:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 107us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583709.755347:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00080000:2.0:1789583709.755365:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583709.755369:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583709.755372:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583709.755533:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+2:2357:x1876514313353088:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 426us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583709.755542:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:3.0:1789583709.755557:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:3.0:1789583709.755566:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2357:x1876514313353216:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:3.0:1789583709.755578:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2eea 00000100:00080000:3.0:1789583709.755584:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b67525b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789583709.755605:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789583709.755799:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+2:2357:x1876514313353216:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 234us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583709.755825:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00010000:00010000:3.0:1789583709.755885:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583709.755906:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583709.756532:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313352704 00000100:00100000:1.0:1789583709.756540:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313352704 00000100:00100000:1.0:1789583709.756580:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 226 00000100:00100000:1.0:1789583709.756589:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313352704:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583709.756639:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313352704:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 50us (2066us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583709.756645:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 226 00000001:02000400:0.0:1789583710.466424:0:11034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789583710.759054:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583711.786482:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583712.829743:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583712.875431:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000020:00000080:3.0:1789583712.875440:0:7663:0:(genops.c:885:class_export_put()) final put ffff88b67525e000/7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000020:00000080:1.0:1789583712.880403:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67525e000/7452e9e9-4caa-4b5a-b84c-d7e502425f35 for lustre-OST0001 00000020:00000080:2.0:1789583712.881001:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b67525b000 for lustre-OST0001 00000020:00000080:0.0:1789583713.802703:0:11183:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdde2d8a0 20000000:00000080:0.0:1789583713.802719:0:11183:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b67b1d5000 uarg=0000000000000000 20000000:01000000:0.0:1789583713.802763:0:11183:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789583713.802769:0:11183:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789583713.802773:0:11183:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789583713.803616:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789583713.803781:0:11183:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789583713.810433:0:11183:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789583713.810466:0:11183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810487:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810515:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810521:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810528:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810535:0:11183:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810542:0:11183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810584:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810601:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.810615:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648882300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260096:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583713.810933:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.810942:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 18 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.810952:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648881180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260224:0@lo:104: 00000100:00100000:0.0:1789583713.811000:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789583713.811039:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811048:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 18 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.811056:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648881500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260352:0@lo:104: 00000100:00100000:0.0:1789583713.811078:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583713.811106:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332260224 00000100:00100000:0.0:1789583713.811113:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332260224 00000100:00100000:0.0:1789583713.811148:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332260352 00000100:00100000:0.0:1789583713.811151:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332260352 00000100:00100000:0.0:1789583713.811166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789583713.811175:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:11183:x1876514332260224:12345-0@lo:104: 00010000:00010000:0.0:1789583713.811187:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811232:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789583713.811238:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:11183:x1876514332260224:12345-0@lo:104: Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.811245:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789583713.811262:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789583713.811269:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:11183:x1876514332260352:12345-0@lo:104: 00010000:00010000:0.0:1789583713.811276:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811305:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789583713.811310:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:11183:x1876514332260352:12345-0@lo:104: Request processed in 42us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.811322:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789583713.811365:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811374:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 18 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.811383:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648881880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260480:0@lo:104: 00000100:00100000:0.0:1789583713.811406:0:11183:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583713.811425:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332260480 00000100:00100000:0.0:1789583713.811429:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332260480 00000100:00100000:0.0:1789583713.811445:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789583713.811451:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:11183:x1876514332260480:12345-0@lo:104: 00010000:00010000:0.0:1789583713.811458:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811490:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789583713.811495:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:11183:x1876514332260480:12345-0@lo:104: Request processed in 46us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.811501:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789583713.811526:0:11183:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811535:0:11183:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.811544:0:11183:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260608:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583713.811570:0:11183:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b58ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583713.811598:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648881180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260224:0@lo:104: 00000100:00100000:0.0:1789583713.811606:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648881500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260352:0@lo:104: 00000100:00100000:0.0:1789583713.811613:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648881880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260480:0@lo:104: 00010000:00010000:0.0:1789583713.811640:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789583713.811646:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811653:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cba00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583713.811658:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811667:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583713.811674:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583713.811681:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789583713.811710:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811717:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583713.811735:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811757:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752cba00/0x6d3e73d72c6e2eb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811771:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789583713.811774:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811786:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752ca800 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583713.811789:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811796:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583713.811803:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583713.811837:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789583713.811855:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811862:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583713.811869:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811876:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752ca800/0x6d3e73d72c6e2eab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811885:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583713.811888:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811894:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583713.811897:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811914:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583713.811922:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583713.811927:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789583713.811942:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811948:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583713.811963:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811970:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b68216f600/0x6d3e73d72c6e2e9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.811984:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583713.811986:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583713.811988:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583713.812007:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332260992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583713.812037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583713.812067:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332260736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583713.812089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583713.812106:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789583713.812112:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332260864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583713.812131:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583713.812155:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332260992 00000100:00100000:0.0:1789583713.812165:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332260992 00010000:00010000:0.0:1789583713.812183:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 19 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.812203:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332260736 00000100:00100000:0.0:1789583713.812206:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332260736 00010000:00010000:0.0:1789583713.812216:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 20 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.812227:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332260864 00000100:00100000:0.0:1789583713.812229:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332260864 00010000:00010000:0.0:1789583713.812240:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 21 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.812252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583713.812258:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3307:x1876514332260992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583713.812267:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583713.812272:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 21 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812281:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 21 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812294:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a02a00/0x6d3e73d72c6e2ea4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2e9d expref: 21 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812306:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583713.812334:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3307:x1876514332260992:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.812340:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583713.812378:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583713.812389:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332260736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583713.812397:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583713.812401:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 19 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812408:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 19 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812419:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752ca200/0x6d3e73d72c6e2ec0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eb9 expref: 19 pid: 5841 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812427:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583713.812453:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:3305:x1876514332260736:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.812459:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583713.812473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789583713.812479:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:3305:x1876514332260864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583713.812486:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583713.812490:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 17 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812498:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 17 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812507:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2eb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2eab expref: 17 pid: 5842 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.812515:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583713.812536:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3305:x1876514332260864:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.812549:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789583713.812577:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332260992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583713.812601:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332260864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583713.812608:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332260736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789583713.812731:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583713.812736:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583713.817680:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583713.817829:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353344 00000100:00100000:1.0:1789583713.817837:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353344 00010000:00010000:1.0:1789583713.817873:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 13 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583713.817907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:1.0:1789583713.817924:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313353344:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583713.817939:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583713.817946:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 13 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583713.817958:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 13 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583713.817977:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583713.818032:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313353344:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583713.818040:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00010000:00010000:0.0:1789583713.818373:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cbc00/0x6d3e73d72c6e2ed5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6348 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.818388:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648882300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260096:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583713.818399:0:11183:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11183:1876514332260608:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583713.818429:0:11183:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583713.818990:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583713.819074:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353472 00000100:00100000:0.0:1789583713.819081:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353472 00010000:00010000:0.0:1789583713.819104:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583713.819133:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:0.0:1789583713.819141:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+12:2358:x1876514313353472:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583713.819153:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583713.819159:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819169:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819198:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216f400/0x6d3e73d72c6e2e96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6310 expref: 12 pid: 5842 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819213:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819221:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819236:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819242:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819250:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819257:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819263:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583713.819267:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819275:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819297:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583713.819317:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583713.819410:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+11:2358:x1876514313353472:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 268us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583713.819417:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00010000:00010000:1.0:1789583713.819477:0:11183:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583713.819485:0:11183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583713.819491:0:11183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cb000/0x6d3e73d72c6e2ef1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583713.831147:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583713.831169:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332261120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583713.831234:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583713.831279:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261120 00000100:00100000:2.0:1789583713.831286:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261120 00000100:00100000:2.0:1789583713.831349:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789583713.831359:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332261120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583713.831398:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583713.831444:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332261120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583713.831452:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789583713.831473:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789583713.831502:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b1d3800 x1876514332261120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583713.831520:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332261120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583713.835143:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332261248:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835216:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583713.835252:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583713.835259:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332261376:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835279:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583713.835307:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261248 00000100:00100000:2.0:1789583713.835314:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261248 00000100:00100000:2.0:1789583713.835350:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261376 00000100:00100000:2.0:1789583713.835353:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261376 00000100:00100000:2.0:1789583713.835380:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789583713.835389:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332261248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835439:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332261248:12345-0@lo:400:kworker.0 Request processed in 50us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583713.835446:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789583713.835463:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789583713.835469:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332261376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835494:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332261376:12345-0@lo:400:kworker.0 Request processed in 25us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583713.835500:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1789583713.835522:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583713.835549:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332261376:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835559:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332261248:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835583:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332261504:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835607:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583713.835624:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583713.835630:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332261632:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583713.835689:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261632 00000100:00100000:2.0:1789583713.835693:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261632 00000100:00100000:2.0:1789583713.835724:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789583713.835731:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332261632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835779:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332261632:12345-0@lo:400:kworker.0 Request processed in 49us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583713.835785:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789583713.835831:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583713.835840:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261504 00000100:00100000:2.0:1789583713.835843:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261504 00000100:00100000:2.0:1789583713.835869:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789583713.835875:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332261504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.835904:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332261504:12345-0@lo:400:kworker.0 Request processed in 29us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583713.835908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1789583713.835923:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789583713.836093:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b1d0700 x1876514332261632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583713.836104:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332261632:0@lo:400:kworker.0 00000100:00100000:2.0:1789583713.836114:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332261504:0@lo:400:kworker.0 00010000:00010000:0.0:1789583713.839705:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789583713.943395:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000020:00000080:1.0:1789583713.943405:0:6732:0:(genops.c:885:class_export_put()) final put ffff88b67c4a7000/7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000020:00000080:1.0:1789583713.943437:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67c4a7000/7452e9e9-4caa-4b5a-b84c-d7e502425f35 for lustre-OST0000 00000020:00000080:1.0:1789583713.943477:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b67c4a2000 for lustre-OST0000 00000100:00100000:2.0:1789583714.344774:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332261760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583714.344862:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583714.345027:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261760 00000100:00100000:0.0:1789583714.345035:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261760 00000100:00100000:0.0:1789583714.345084:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789583714.345094:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332261760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583714.345127:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583714.345180:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332261760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583714.345186:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789583714.345266:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1df100 x1876514332261760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583730 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583714.345284:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332261760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583714.855342:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583714.868599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583714.868704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583714.868751:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583714.868825:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353600 00000100:00100000:1.0:1789583714.868837:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353600 00000100:00100000:1.0:1789583714.868891:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 227 00000100:00100000:1.0:1789583714.868913:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+11:2358:x1876514313353600:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583714.868981:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+11:2358:x1876514313353600:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583714.868989:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 227 00000100:00100000:0.0:1789583714.871145:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353728 00000100:00100000:0.0:1789583714.871158:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353728 00000100:00100000:0.0:1789583714.871410:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353856 00000100:00100000:0.0:1789583714.871415:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353856 00000100:00080000:3.0:1789583714.875008:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583714.875086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:3.0:1789583714.875104:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313353728:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583714.875184:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313353728:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 88us (6593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583714.875558:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:1.0:1789583714.875918:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:1.0:1789583714.875928:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313353856:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583714.875970:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313353856:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 44us (7218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583714.875976:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 10000000:01000000:2.0:1789583715.366885:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789583715.366892:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b66de3b000 from 7 10000000:01000000:2.0:1789583715.366897:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789583715.366946:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.366958:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.366970:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583715.366997:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332261888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.367065:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583715.367115:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583715.367301:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332261888 00000100:00100000:3.0:1789583715.367309:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332261888 00000100:00100000:3.0:1789583715.367363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789583715.367372:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332261888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583715.367385:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583715.367398:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2ef8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.367420:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.367430:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.367438:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03800, rc 0) 00000100:00100000:3.0:1789583715.367484:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332261888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583715.367490:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789583715.367571:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332261888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583715.367585:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.367593:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583715.367644:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.367682:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583715.367703:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583715.367751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262016 00000100:00100000:3.0:1789583715.367756:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262016 00000100:00100000:3.0:1789583715.367786:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789583715.367793:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332262016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.368049:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332262016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583715.368056:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789583715.368250:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.368293:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.368330:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583715.368354:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583715.368470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262144 00000100:00100000:3.0:1789583715.368480:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262144 00000100:00100000:3.0:1789583715.368507:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789583715.368515:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332262144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.369672:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332262144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583715.369682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789583715.369752:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789583715.374917:0:11225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789583715.375339:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789583715.375381:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789583715.375391:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.375403:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583715.375412:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789583715.375415:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b64a171800 from 7 10000000:01000000:2.0:1789583715.375418:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789583715.375452:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.375460:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.375471:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583715.375497:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.375561:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583715.375601:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583715.377272:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262272 00000100:00100000:3.0:1789583715.377283:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262272 00000100:00100000:3.0:1789583715.377344:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789583715.377354:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332262272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583715.377371:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583715.377559:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2f06 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.377586:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.377596:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.377604:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02400, rc 0) 00000100:00100000:3.0:1789583715.377676:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332262272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583715.377682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789583715.378800:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583715.378905:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.378916:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583715.378992:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583715.379040:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583715.379155:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789583715.379239:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262400 00000100:00100000:2.0:1789583715.379259:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262400 00000100:00100000:2.0:1789583715.379292:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789583715.379301:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332262400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.380009:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332262400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 707us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583715.380019:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789583715.380155:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583715.380198:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583715.380244:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583715.380282:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c80600 going to sleep for 11 seconds 00000100:00100000:2.0:1789583715.380465:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262528 00000100:00100000:2.0:1789583715.380477:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262528 00000100:00100000:2.0:1789583715.380517:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789583715.380525:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332262528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.380678:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332262528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583715.380685:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789583715.380761:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789583715.383015:0:11229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789583715.385903:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789583715.385939:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583715.385951:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.385963:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583715.385972:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789583715.385975:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666645000 from 7 10000000:01000000:3.0:1789583715.385977:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789583715.386016:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.386024:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.386035:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583715.386059:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.386123:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583715.386166:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66678acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583715.386569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262656 00000100:00100000:2.0:1789583715.386576:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262656 00000100:00100000:2.0:1789583715.386623:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789583715.386631:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332262656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583715.386644:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583715.386657:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e2f14 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.386680:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.386689:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.386696:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1200, rc 0) 00000100:00100000:2.0:1789583715.386749:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332262656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583715.386754:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789583715.387572:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583715.387589:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583715.387599:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583715.387668:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.387705:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583715.387749:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66678acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583715.387795:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262784 00000100:00100000:0.0:1789583715.387800:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262784 00000100:00100000:0.0:1789583715.388006:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789583715.388016:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332262784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583715.388263:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332262784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583715.388270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789583715.388325:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.388352:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.388400:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583715.392508:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66678acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583715.392685:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332262912 00000100:00100000:2.0:1789583715.392699:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332262912 00000100:00100000:2.0:1789583715.392761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789583715.392771:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332262912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583715.393101:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332262912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (4700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583715.393110:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789583715.393562:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332262912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789583715.394561:0:11232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789583715.394704:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789583715.394720:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789583715.394740:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583715.394752:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583715.447037:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583715.447132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313353984 00000100:00100000:0.0:1789583715.447142:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313353984 00000100:00100000:0.0:1789583715.447195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 237 00000100:00100000:0.0:1789583715.447205:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+11:5599:x1876514313353984:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583715.447222:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583715.447240:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6372 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.447280:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.447291:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.447300:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca800, rc 0) 00000100:00100000:0.0:1789583715.447352:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313353984:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 149us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583715.447359:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 237 00000100:00100000:1.0:1789583715.454661:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583715.454753:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354112 00000100:00100000:3.0:1789583715.454763:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354112 00000100:00100000:3.0:1789583715.454837:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 238 00000100:00100000:3.0:1789583715.454848:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313354112:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.455127:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313354112:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 280us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583715.455135:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 238 00000100:00100000:1.0:1789583715.460674:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583715.460765:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354240 00000100:00100000:3.0:1789583715.460774:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354240 00000100:00100000:3.0:1789583715.460879:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 239 00000100:00100000:3.0:1789583715.460890:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313354240:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583715.461114:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313354240:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 226us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583715.461132:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 239 00000100:00100000:1.0:1789583715.472460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583715.472571:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354368 00000100:00100000:0.0:1789583715.472590:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354368 00000100:00100000:0.0:1789583715.472639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:0.0:1789583715.472648:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313354368:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583715.472664:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583715.472682:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6379 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.472707:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.472719:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583715.472736:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752caa00, rc 0) 00000100:00100000:0.0:1789583715.472783:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313354368:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 137us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583715.472790:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:0.0:1789583715.483408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583715.483541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354496 00000100:00100000:1.0:1789583715.483552:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354496 00000100:00100000:1.0:1789583715.483611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 241 00000100:00100000:1.0:1789583715.483621:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313354496:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583715.483939:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313354496:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 318us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583715.483947:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 241 00000100:00100000:0.0:1789583715.488631:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583715.488742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354624 00000100:00100000:1.0:1789583715.488752:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354624 00000100:00100000:1.0:1789583715.488822:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 242 00000100:00100000:1.0:1789583715.488833:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313354624:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583715.489099:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313354624:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 267us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583715.489107:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 242 00010000:00010000:3.0:1789583715.881352:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583716.903381:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583717.928014:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789583718.249548:0:11381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789583718.952368:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583718.953069:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332263040:0@lo:400:kworker.0 00000100:00100000:0.0:1789583718.953137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583718.953190:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332263552:0@lo:400:kworker.0 00000100:00100000:0.0:1789583718.953220:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583718.953258:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583718.953279:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332263424:0@lo:400:kworker.0 00000100:00100000:0.0:1789583718.953318:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583718.953347:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263552 00000100:00100000:0.0:1789583718.953355:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263552 00000100:00100000:0.0:1789583718.953413:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789583718.953423:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332263552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583718.953471:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332263552:12345-0@lo:400:kworker.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583718.953489:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789583718.953571:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263040 00000100:00100000:1.0:1789583718.953575:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263040 00000100:00100000:1.0:1789583718.953612:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789583718.953620:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332263040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583718.953661:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332263040:12345-0@lo:400:kworker.0 Request processed in 43us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583718.953667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789583718.953865:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332263552:0@lo:400:kworker.0 00000100:00100000:0.0:1789583718.953887:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332263040:0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332263168:0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583718.954330:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332263680:0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954350:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583718.954368:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583718.954374:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332263296:0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954392:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583718.954415:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263424 00000100:00100000:2.0:1789583718.954419:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263424 00000100:00100000:2.0:1789583718.954446:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263680 00000100:00100000:2.0:1789583718.954449:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263680 00000100:00100000:2.0:1789583718.954464:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789583718.954470:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332263424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954517:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332263424:12345-0@lo:400:kworker.0 Request processed in 47us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583718.954522:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789583718.954546:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789583718.954560:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332263680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954590:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332263680:12345-0@lo:400:kworker.0 Request processed in 39us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583718.954595:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789583718.954610:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263168 00000100:00100000:2.0:1789583718.954613:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263168 00000100:00100000:2.0:1789583718.954634:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263296 00000100:00100000:2.0:1789583718.954636:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263296 00000100:00100000:2.0:1789583718.954654:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789583718.954660:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332263168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954689:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332263168:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583718.954695:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789583718.954716:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789583718.954722:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332263296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954747:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332263296:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583718.954753:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789583718.954786:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332263296:0@lo:400:kworker.0 00000100:00100000:2.0:1789583718.954795:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332263168:0@lo:400:kworker.0 00010000:00080000:2.0:1789583718.954827:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752da300 x1876514332263680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583718.954837:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332263680:0@lo:400:kworker.0 00010000:00080000:2.0:1789583718.954871:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752daa00 x1876514332263424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583718.954887:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332263424:0@lo:400:kworker.0 00000100:00100000:3.0:1789583718.955176:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332263808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583718.955208:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789583718.955250:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583718.955254:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789583718.955257:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583718.955312:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263808 00000100:00100000:1.0:1789583718.955317:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263808 00000100:00100000:1.0:1789583718.955353:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789583718.955361:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332263808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583718.955388:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583718.955424:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332263808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583718.955430:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789583718.955952:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67baae300 x1876514332263808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583718.955968:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332263808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583719.464265:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332263936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583719.464352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583719.464564:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332263936 00000100:00100000:0.0:1789583719.464573:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332263936 00000100:00100000:0.0:1789583719.464623:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789583719.464633:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332263936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583719.464665:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583719.464718:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332263936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583719.464726:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789583719.464837:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880000 x1876514332263936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583719.464857:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332263936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583719.975004:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583719.990903:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583719.990945:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583719.991357:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354752 00000100:00100000:2.0:1789583719.991368:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354752 00000100:00100000:2.0:1789583719.991429:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 244 00000100:00100000:2.0:1789583719.991439:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313354752:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583719.991507:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313354752:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 70us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583719.991515:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 244 00000100:00100000:2.0:1789583719.991569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583719.994469:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313354880 00000100:00100000:0.0:1789583719.994483:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313354880 00000100:00080000:1.0:1789583719.994553:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583719.994569:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313355008 00000100:00100000:0.0:1789583719.994573:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313355008 00000100:00100000:0.0:1789583719.994624:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:0.0:1789583719.994649:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313354880:12345-192.168.203.46@tcp:400:kworker.0 00000100:00080000:1.0:1789583719.994678:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583719.994717:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:1.0:1789583719.994729:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2359:x1876514313355008:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583719.994733:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313354880:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 85us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583719.994742:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:1.0:1789583719.994765:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2359:x1876514313355008:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 39us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583719.994771:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 89 00010000:00010000:1.0:1789583721.000442:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789583721.024017:0:11481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:35:19 (1789583719) === 00000100:00100000:2.0:1789583721.210169:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583721.210205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583721.210448:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313355264 00000100:00100000:3.0:1789583721.210457:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313355264 00000100:00100000:3.0:1789583721.210559:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:3.0:1789583721.210570:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:9694:x1876514313355264:12345-192.168.203.46@tcp:700:mkdir.0 00000100:00100000:3.0:1789583721.210665:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:9694:x1876514313355264:12345-192.168.203.46@tcp:700:mkdir.0 Request processed in 98us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583721.210673:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583721.212530:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313355136 00000100:00100000:0.0:1789583721.212541:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313355136 00000100:00100000:0.0:1789583721.212588:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:0.0:1789583721.212596:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313355136:12345-192.168.203.46@tcp:41:mkdir.0 00000004:00000024:0.0:1789583721.212633:0:8280:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789583721.212729:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313355136:12345-192.168.203.46@tcp:41:mkdir.0 Request processed in 131us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583721.212737:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00080000:1.0:1789583721.212770:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583721.217126:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583721.217598:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313355520 00000100:00100000:3.0:1789583721.217608:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313355520 00000100:00100000:3.0:1789583721.217669:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:3.0:1789583721.217680:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:9694:x1876514313355520:12345-192.168.203.46@tcp:36:mkdir.0 00010000:00010000:3.0:1789583721.217747:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583721.217795:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2e11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62fb expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.217853:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64336a600) 00010000:00010000:3.0:1789583721.217867:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583721.218363:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.218427:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.218440:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.218470:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.218479:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.218485:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583721.220611:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789583721.220629:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.220639:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.220647:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.220654:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583721.220666:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.220674:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.220698:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64336a200) 00010000:00010000:3.0:1789583721.220701:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583721.220706:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.220713:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2f30 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583721.220735:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002214c780 reply state 00000000726ad481 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583721.220745:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583721.220876:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9694:x1876514313355520:12345-192.168.203.46@tcp:36:mkdir.0 Request processed in 3195us (3755us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789583721.220885:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00010000:00010000:3.0:1789583721.223517:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.223534:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.223541:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.223547:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583721.223550:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.223569:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.223585:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88b64336a500) 00010000:00010000:3.0:1789583721.223588:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583721.223592:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.223598:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2f37 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583721.229607:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.229922:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313355648 00000100:00100000:0.0:1789583721.229932:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313355648 00000100:00100000:0.0:1789583721.230034:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789583721.230045:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:9695:x1876514313355648:12345-192.168.203.46@tcp:101:chmod.0 00010000:00010000:0.0:1789583721.230067:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583721.230093:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e2f3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6380 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.230156:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e2f45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.230170:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e2f45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.230181:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e2f45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583721.230230:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789583721.230234:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583721.230272:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e2f45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.230298:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e2f3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6380 expref: 8 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.230314:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e2f45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6380 expref: 7 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.230323:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76d00) 00010000:00010000:0.0:1789583721.230326:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583721.230330:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca200, rc 0) 00000100:00100000:0.0:1789583721.230389:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9695:x1876514313355648:12345-192.168.203.46@tcp:101:chmod.0 Request processed in 347us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583721.230412:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583721.233681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583721.235125:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313355904 00000100:00100000:2.0:1789583721.235138:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313355904 00000100:00100000:2.0:1789583721.235278:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789583721.235289:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9695:x1876514313355904:12345-192.168.203.46@tcp:36:chmod.0 00010000:00010000:2.0:1789583721.235341:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583721.235368:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e2f45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6380 expref: 7 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.235404:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76d00) 00010000:00010000:2.0:1789583721.235419:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583721.235445:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.235457:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.235466:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583721.235935:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f1af4357 reply state 0000000038cb66e9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583721.235946:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789583721.235953:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789583721.236036:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:9695:x1876514313355904:12345-192.168.203.46@tcp:36:chmod.0 Request processed in 749us (2365us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789583721.236044:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00010000:00010000:0.0:1789583721.238486:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.238501:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.238509:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.238516:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583721.238520:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.238534:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.238550:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4900) 00010000:00010000:0.0:1789583721.238553:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789583721.238569:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.238576:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f4c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583721.265195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583721.265634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313356032 00000100:00100000:1.0:1789583721.265645:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313356032 00000100:00100000:1.0:1789583721.265706:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789583721.265716:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9696:x1876514313356032:12345-192.168.203.46@tcp:101:chown.0 00010000:00010000:1.0:1789583721.265740:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583721.265762:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6387 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.265867:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e2f5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.265881:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e2f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.265898:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e2f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583721.265932:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789583721.265948:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583721.265990:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e2f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.266014:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6387 expref: 9 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.266030:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e2f5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6387 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.266038:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246300) 00010000:00010000:1.0:1789583721.266040:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583721.266044:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583721.266108:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:9696:x1876514313356032:12345-192.168.203.46@tcp:101:chown.0 Request processed in 394us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583721.266116:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:1.0:1789583721.269162:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583721.269461:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313356160 00000100:00100000:2.0:1789583721.269471:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313356160 00000100:00100000:2.0:1789583721.269528:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583721.269540:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:9696:x1876514313356160:12345-192.168.203.46@tcp:101:chown.0 00010000:00010000:2.0:1789583721.269561:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583721.269581:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e2f61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec638e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269647:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269674:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269695:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269710:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269717:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269724:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269797:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e2f76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269821:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e2f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269831:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e2f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583721.269858:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789583721.269861:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583721.269878:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e2f76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269890:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269905:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269912:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269918:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583721.269922:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269929:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269940:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246300) 00010000:00010000:2.0:1789583721.269943:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583721.269947:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269953:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0600/0x6d3e73d72c6e2f68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269966:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269972:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269978:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.269983:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583721.269989:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.270232:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.270241:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88b6583d4d00) 00010000:00010000:2.0:1789583721.270244:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583721.270247:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.270253:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0000/0x6d3e73d72c6e2f6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.270340:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e2f61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec638e expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.270355:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e2f76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec638e expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.270424:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b6583d4b00) 00010000:00010000:2.0:1789583721.270469:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583721.270471:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1000, rc 0) 00000100:00100000:2.0:1789583721.270583:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:9696:x1876514313356160:12345-192.168.203.46@tcp:101:chown.0 Request processed in 1044us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583721.270591:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583721.280955:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583721.281205:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313356416 00000100:00100000:1.0:1789583721.281215:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313356416 00000100:00100000:1.0:1789583721.281276:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789583721.281286:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:9696:x1876514313356416:12345-192.168.203.46@tcp:36:chown.0 00010000:00010000:1.0:1789583721.281335:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583721.281359:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e2f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec638e expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.281379:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b6583d4b00) 00010000:00010000:1.0:1789583721.281388:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583721.281486:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.281512:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.281522:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789583721.319497:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789583721.319575:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd49083f reply state 000000008b03941d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583721.319588:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789583721.319603:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789583721.319710:0:5850:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789583721.319728:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9696:x1876514313356416:12345-192.168.203.46@tcp:36:chown.0 Request processed in 38440us (38779us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789583721.319737:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00010000:00010000:0.0:1789583721.319778:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.319788:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.320145:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.320153:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583721.320491:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.320501:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.320517:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246200) 00010000:00010000:0.0:1789583721.320521:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789583721.320526:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.320533:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e2f7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583721.343264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.343544:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313356544 00000100:00100000:0.0:1789583721.343559:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313356544 00000100:00100000:0.0:1789583721.343621:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:0.0:1789583721.343631:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67badf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:9697:x1876514313356544:12345-192.168.203.46@tcp:101:touch.500 00010000:00010000:0.0:1789583721.343654:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583721.343674:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e2f84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6395 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789583721.345892:0:8280:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2157us 00010000:00010000:1.0:1789583721.369834:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.369856:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.369867:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.369883:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.369891:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.369898:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370220:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e2f99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370230:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e2f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370237:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e2f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583721.370270:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789583721.370274:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583721.370325:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e2f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370337:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370344:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370351:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370357:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.370361:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370368:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370384:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246300) 00010000:00010000:1.0:1789583721.370387:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583721.370392:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370398:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e2f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370411:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370428:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370434:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370439:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.370443:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370450:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370458:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88b645246000) 00010000:00010000:1.0:1789583721.370461:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583721.370464:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370470:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e2f92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370508:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e2f84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6395 expref: 8 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370521:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e2f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6395 expref: 7 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.370534:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:1.0:1789583721.370537:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789583721.370547:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb200, rc 0) 00000100:00100000:1.0:1789583721.370617:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67badf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9697:x1876514313356544:12345-192.168.203.46@tcp:101:touch.500 Request processed in 26987us (27361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583721.370630:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:2.0:1789583721.377633:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583721.377724:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313356800 00000100:00100000:3.0:1789583721.377735:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313356800 00000100:00100000:3.0:1789583721.377916:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:3.0:1789583721.377927:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:9697:x1876514313356800:12345-192.168.203.46@tcp:101:touch.500 00010000:00010000:3.0:1789583721.377948:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583721.377970:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2fa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec639c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.378215:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.378230:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.378242:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.378330:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.378339:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.378346:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789583721.379105:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789583721.379452:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e2fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379464:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e2fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379473:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e2fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379500:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379508:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379515:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379520:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583721.379525:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379543:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379555:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:3.0:1789583721.379557:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583721.379562:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379568:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e2fa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583721.379581:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040cdd68d reply state 000000004dbca380 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583721.379589:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789583721.379618:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2fa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec639c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379630:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e2fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec639c expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.379637:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b64336a200) 00010000:00010000:3.0:1789583721.379640:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583721.379642:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03400, rc 0) 00000100:00100000:3.0:1789583721.379755:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+10:9697:x1876514313356800:12345-192.168.203.46@tcp:101:touch.500 Request processed in 1830us (2130us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789583721.379763:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00010000:00010000:0.0:1789583721.388018:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.388036:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.388045:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.388071:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583721.388076:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.388085:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.388104:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff88b64336a500) 00010000:00010000:0.0:1789583721.388107:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583721.388112:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.388118:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e2fae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583721.397511:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.398926:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313357056 00000100:00100000:0.0:1789583721.398997:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313357056 00000100:00100000:0.0:1789583721.399252:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789583721.399265:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:9697:x1876514313357056:12345-192.168.203.46@tcp:36:touch.500 00010000:00010000:0.0:1789583721.399522:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583721.399551:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e2fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec639c expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.399572:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b64336a200) 00010000:00010000:0.0:1789583721.399584:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583721.399650:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.399665:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.399692:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789583721.400028:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030fe8bc6 reply state 00000000fc5d1aae transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583721.400038:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789583721.400455:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+10:9697:x1876514313357056:12345-192.168.203.46@tcp:36:touch.500 Request processed in 1184us (2945us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789583721.400463:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789583721.408640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.408700:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313357184 00000100:00100000:0.0:1789583721.408709:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313357184 00000100:00100000:0.0:1789583721.408767:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789583721.408777:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+10:9697:x1876514313357184:12345-192.168.203.46@tcp:101:touch.500 00010000:00010000:0.0:1789583721.408801:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583721.408861:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e2fca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63a3 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.408926:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e2fca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63a3 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.408940:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e2fca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63a3 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.408959:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b643e76c00) 00010000:00010000:0.0:1789583721.408962:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789583721.408981:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cb000, rc 0) 00010000:00010000:3.0:1789583721.409044:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.409075:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.409084:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.409092:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583721.409098:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.409108:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.409127:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b643e76c00) 00010000:00010000:3.0:1789583721.409131:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583721.409137:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.409144:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2fc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583721.409592:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+10:9697:x1876514313357184:12345-192.168.203.46@tcp:101:touch.500 Request processed in 812us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583721.409602:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789583721.420010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583721.422502:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313357312 00000100:00100000:2.0:1789583721.422516:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313357312 00000100:00100000:2.0:1789583721.422562:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789583721.422569:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1876514313357312:12345-192.168.203.46@tcp:8:touch.500 00010000:00080000:2.0:1789583721.422602:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:2.0:1789583721.422631:0:6705:0:(genops.c:1384:class_connect()) connect: client 768b736a-7b4a-4614-9d07-b155a4183a8a, cookie 0x6d3e73d72c6e2fd1 00002000:00100000:2.0:1789583721.422641:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 768b736a-7b4a-4614-9d07-b155a4183a8a/ffff88b644567000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789583721.422662:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789583721.423017:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789583721.423047:0:6705:0:(import.c:65:import_set_state_nolock()) ffff88b644561800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583721.423113:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2357:x1876514313357312:12345-192.168.203.46@tcp:8:touch.500 Request processed in 543us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583721.423120:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789583721.430706:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.430847:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313357440 00000100:00100000:0.0:1789583721.430857:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313357440 00000100:00100000:0.0:1789583721.430919:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789583721.430930:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:0:x1876514313357440:12345-192.168.203.46@tcp:2:touch.500 00000100:00080000:1.0:1789583721.431530:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789583721.464698:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1789583721.464846:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000100:00100000:2.0:1789583721.465076:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:0:x1876514313357440:12345-192.168.203.46@tcp:2:touch.500 Request processed in 34142us (34373us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789583721.465087:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789583721.467547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583721.468493:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313357696 00000100:00100000:1.0:1789583721.468506:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313357696 00000100:00100000:1.0:1789583721.468606:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:1.0:1789583721.468617:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+10:9697:x1876514313357696:12345-192.168.203.46@tcp:35:touch.500 00000100:00100000:1.0:1789583721.469010:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+11:9697:x1876514313357696:12345-192.168.203.46@tcp:35:touch.500 Request processed in 393us (1470us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789583721.469018:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:1.0:1789583721.492239:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.492318:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313357824 00000100:00100000:0.0:1789583721.492329:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313357824 00000100:00100000:0.0:1789583721.492389:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789583721.492400:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+11:9698:x1876514313357824:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:0.0:1789583721.492424:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583721.492444:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e2fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63aa expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.492507:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbe00/0x6d3e73d72c6e2fdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.492521:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbe00/0x6d3e73d72c6e2fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.492533:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbe00/0x6d3e73d72c6e2fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583721.492566:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789583721.492569:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583721.492602:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbe00/0x6d3e73d72c6e2fdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.492642:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e2fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63aa expref: 13 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.492659:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbe00/0x6d3e73d72c6e2fdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63aa expref: 12 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.492667:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:0.0:1789583721.492669:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583721.492673:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cbe00, rc 0) 00000100:00100000:0.0:1789583721.492743:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+12:9698:x1876514313357824:12345-192.168.203.46@tcp:101:rm.0 Request processed in 346us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583721.492751:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789583721.497664:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583721.497753:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313358080 00000100:00100000:3.0:1789583721.497764:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313358080 00000100:00100000:3.0:1789583721.497847:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:3.0:1789583721.497857:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+12:9698:x1876514313358080:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:3.0:1789583721.497877:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583721.497899:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63b1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583721.498000:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789583721.498159:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2fe6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63b1 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.498174:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246300) 00010000:00010000:3.0:1789583721.498177:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583721.498183:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e2fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63b1 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.498195:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03600, rc 0) 00000100:00100000:3.0:1789583721.498255:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+13:9698:x1876514313358080:12345-192.168.203.46@tcp:101:rm.0 Request processed in 399us (600us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789583721.498262:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:1.0:1789583721.501500:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583721.501549:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313358208 00000100:00100000:3.0:1789583721.501561:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313358208 00000100:00100000:3.0:1789583721.501621:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:1.0:1789583721.501630:0:5852:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789583721.501632:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:9698:x1876514313358208:12345-192.168.203.46@tcp:37:rm.0 00000100:00100000:1.0:1789583721.501641:0:5852:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789583721.508219:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:9698:x1876514313358208:12345-192.168.203.46@tcp:37:rm.0 Request processed in 6571us (6710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583721.508242:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:2.0:1789583721.516343:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583721.516467:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313358464 00000100:00100000:1.0:1789583721.516480:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313358464 00000100:00100000:1.0:1789583721.516559:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789583721.516572:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+13:9698:x1876514313358464:12345-192.168.203.46@tcp:35:rm.0 00000100:00100000:1.0:1789583721.516900:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+14:9698:x1876514313358464:12345-192.168.203.46@tcp:35:rm.0 Request processed in 331us (573us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789583721.516910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789583721.520084:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583721.522111:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313358720 00000100:00100000:0.0:1789583721.522129:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313358720 00000100:00100000:0.0:1789583721.522227:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:0.0:1789583721.522240:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+14:9698:x1876514313358720:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:0.0:1789583721.522275:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583721.522303:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e2ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63b8 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.522436:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2ffb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.522455:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.522480:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2ffb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583721.522511:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789583721.522672:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e2ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63b8 expref: 17 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.522708:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2ffb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63b8 expref: 16 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.522718:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:0.0:1789583721.522721:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789583721.522725:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cbc00, rc 0) 00000100:00100000:0.0:1789583721.522880:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313358720:12345-192.168.203.46@tcp:101:rm.0 Request processed in 642us (2809us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789583721.522889:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:2.0:1789583721.526763:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583721.526973:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313358848 00000100:00100000:3.0:1789583721.526986:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313358848 00000100:00100000:3.0:1789583721.527258:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:3.0:1789583721.527272:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313358848:12345-192.168.203.46@tcp:41:rm.0 00000004:00000024:3.0:1789583721.527363:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1789583721.527466:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313358848:12345-192.168.203.46@tcp:41:rm.0 Request processed in 198us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583721.527474:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:0.0:1789583721.534538:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583721.534657:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313358976 00000100:00100000:1.0:1789583721.534698:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313358976 00000100:00100000:1.0:1789583721.534865:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:1.0:1789583721.534878:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313358976:12345-192.168.203.46@tcp:101:rm.0 00010000:00010000:1.0:1789583721.534909:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583721.534941:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63bf expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535039:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535066:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535080:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535098:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535105:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535112:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535248:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535258:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535266:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583721.535315:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789583721.535320:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583721.535343:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535357:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535367:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535499:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535510:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535517:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.535523:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535532:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535546:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:1.0:1789583721.535550:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583721.535556:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535564:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535591:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535598:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535604:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535610:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.535612:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535619:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535626:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff88b645246600) 00010000:00010000:1.0:1789583721.535629:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583721.535632:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535639:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535676:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63bf expref: 18 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535703:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63bf expref: 17 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.535722:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b643e76c00) 00010000:00010000:1.0:1789583721.535725:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583721.535728:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa200, rc 0) 00000100:00100000:1.0:1789583721.535847:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+17:9698:x1876514313358976:12345-192.168.203.46@tcp:101:rm.0 Request processed in 970us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583721.535855:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:0.0:1789583721.542184:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583721.542271:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313359232 00000100:00100000:1.0:1789583721.542293:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313359232 00000100:00100000:1.0:1789583721.542369:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:1.0:1789583721.542397:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+17:9698:x1876514313359232:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:1.0:1789583721.542471:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789583721.542506:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e301e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63bf expref: 17 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542532:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e2fca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63a3 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542544:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b643e76c00) 00010000:00010000:1.0:1789583721.542565:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbe00/0x6d3e73d72c6e2fdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63aa expref: 15 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542575:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:1.0:1789583721.542579:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583721.542608:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542663:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542674:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542700:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542708:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542715:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542946:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542954:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.542961:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583721.543888:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789583721.543905:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 278528098162ns, next at 279528094262ns, rc = 0 00010000:00010000:1.0:1789583721.543982:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.543995:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544017:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544026:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544033:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544040:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544064:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583721.544089:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544096:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544104:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544109:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.544114:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544122:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544133:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b645246000) 00010000:00010000:1.0:1789583721.544136:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789583721.544147:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544153:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3033 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544173:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544180:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544185:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544190:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbe00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.544193:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544199:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544206:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:1.0:1789583721.544208:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583721.544211:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.544216:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e3025 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583721.544224:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4f9d656 reply state 000000000c067fa8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583721.544244:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583721.544367:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313359232:12345-192.168.203.46@tcp:36:rm.0 Request processed in 1977us (2195us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789583721.544377:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00010000:00010000:0.0:1789583721.544737:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583721.544747:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.544754:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583721.544758:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.544765:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.544775:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff88b645246000) 00010000:00010000:0.0:1789583721.544778:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789583721.544789:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.544796:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e303a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583721.544841:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583721.544843:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583721.544845:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583721.552170:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.552193:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.552201:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.552209:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583721.552216:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.552225:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.552246:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff88b645246600) 00010000:00010000:1.0:1789583721.552250:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583721.552256:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583721.552263:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e302c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583721.556152:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583721.556276:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313359488 00000100:00100000:2.0:1789583721.556297:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313359488 00000100:00100000:2.0:1789583721.556382:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:2.0:1789583721.556403:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+15:9698:x1876514313359488:12345-192.168.203.46@tcp:35:rm.0 00000100:00100000:2.0:1789583721.556776:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313359488:12345-192.168.203.46@tcp:35:rm.0 Request processed in 383us (638us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789583721.556785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789583721.560456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583721.560649:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313359744 00000100:00100000:2.0:1789583721.560661:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313359744 00000100:00100000:2.0:1789583721.560746:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:2.0:1789583721.560757:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+16:9698:x1876514313359744:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:2.0:1789583721.561000:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789583721.561039:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e2ffb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63b8 expref: 16 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561064:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e2f99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6395 expref: 15 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561075:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b645246f00) 00010000:00010000:2.0:1789583721.561094:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e2f5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6387 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561103:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246300) 00010000:00010000:2.0:1789583721.561109:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583721.561140:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561156:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561167:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561198:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561206:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.561213:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562031:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562045:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562053:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583721.562750:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789583721.562770:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562785:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562793:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562801:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583721.562914:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562937:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562952:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583721.562955:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789583721.562961:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562966:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e304f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562994:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.562999:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.563005:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.563010:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583721.563013:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.563018:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.563026:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:2.0:1789583721.563028:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583721.563031:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583721.563048:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3041 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583721.563065:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec5f7256 reply state 00000000f70f3f23 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583721.563075:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583721.563247:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+15:9698:x1876514313359744:12345-192.168.203.46@tcp:36:rm.0 Request processed in 2488us (2804us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789583721.563258:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00010000:00010000:3.0:1789583721.572219:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.572243:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.572252:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.572259:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583721.572265:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.572275:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.572364:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88b6583d4900) 00010000:00010000:3.0:1789583721.572368:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583721.572377:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583721.572384:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3048 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583722.023704:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583723.047066:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789583724.071404:0:7126:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 281055595529ns, next at 282055593114ns, rc = 0 00000100:00100000:2.0:1789583724.071730:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332264064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583724.071796:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583724.071878:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264064 00000100:00100000:3.0:1789583724.071897:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264064 00000100:00080000:3.0:1789583724.071955:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583724.072403:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789583724.072415:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332264064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583724.072451:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583724.072501:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332264064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583724.072508:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789583724.072549:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67baaf100 x1876514332264064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583724.072568:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332264064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789583724.074297:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583724.075803:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332264320:0@lo:400:kworker.0 00000100:00100000:3.0:1789583724.075891:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583724.075891:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332264448:0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.075944:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583724.075947:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789583724.075956:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332264192:0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.075985:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583724.075996:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332264576:0@lo:400:kworker.0 00000100:00100000:3.0:1789583724.075997:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583724.076028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583724.076062:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264320 00000100:00100000:2.0:1789583724.076069:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264320 00000100:00100000:3.0:1789583724.076088:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332264704:0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.076107:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264448 00000100:00100000:2.0:1789583724.076111:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264448 00000100:00100000:3.0:1789583724.076122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583724.076134:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264576 00000100:00100000:2.0:1789583724.076138:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264576 00000100:00100000:2.0:1789583724.076159:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789583724.076169:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332264320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583724.076173:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789583724.076186:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583724.076240:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332264448:12345-0@lo:400:kworker.0 Request processed in 57us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583724.076247:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789583724.076266:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789583724.076272:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332264576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583724.076300:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332264576:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583724.076305:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789583724.076326:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264704 00000100:00100000:3.0:1789583724.076331:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264704 00000100:00100000:3.0:1789583724.076359:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789583724.076366:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332264704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.076404:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332264320:12345-0@lo:400:kworker.0 Request processed in 236us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583724.076411:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789583724.076425:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332264704:12345-0@lo:400:kworker.0 Request processed in 58us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583724.076433:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789583724.076463:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583724.076469:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583724.076473:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67509e300 x1876514332264704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583724.076486:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332264704:0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.076493:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332264576:0@lo:400:kworker.0 00000100:00100000:3.0:1789583724.076507:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332264320:0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.076510:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332264448:0@lo:400:kworker.0 00000100:00100000:0.0:1789583724.078161:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264192 00000100:00100000:0.0:1789583724.078173:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264192 00000100:00100000:2.0:1789583724.078377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789583724.078387:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3308:x1876514332264192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.078461:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3308:x1876514332264192:12345-0@lo:400:kworker.0 Request processed in 75us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583724.078467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789583724.078483:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332264192:0@lo:400:kworker.0 00000100:00100000:2.0:1789583724.583252:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583724.583281:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332264832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583724.583362:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583724.583421:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332264832 00000100:00100000:0.0:1789583724.583433:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332264832 00000100:00100000:0.0:1789583724.583652:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789583724.583673:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332264832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583724.583726:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583724.583841:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332264832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583724.583850:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789583724.583879:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97dc00 x1876514332264832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583724.584110:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332264832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583725.098930:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583725.113014:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583725.113044:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583725.113070:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583725.113096:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583725.113174:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313359872 00000100:00100000:1.0:1789583725.113182:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313359872 00000100:00100000:1.0:1789583725.113236:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 246 00000100:00100000:1.0:1789583725.113246:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313359872:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583725.113311:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313359872:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 66us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583725.113318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 246 00000100:00100000:1.0:1789583725.113629:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360000 00000100:00100000:1.0:1789583725.113634:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360000 00000100:00100000:1.0:1789583725.113685:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360256 00000100:00100000:1.0:1789583725.113689:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360256 00000100:00100000:1.0:1789583725.113935:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:1.0:1789583725.113943:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+14:2358:x1876514313360000:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583725.113986:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+14:2358:x1876514313360000:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 45us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583725.113992:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:1.0:1789583725.114007:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:1.0:1789583725.114013:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313360256:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583725.114035:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313360256:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583725.114040:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:3.0:1789583725.114412:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360128 00000100:00100000:3.0:1789583725.114418:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360128 00000100:00080000:1.0:1789583725.114502:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583725.114513:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583725.114713:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:3.0:1789583725.114722:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313360128:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583725.114780:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313360128:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 59us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583725.114787:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000001:02000400:1.0:1789583725.246638:0:11632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789583726.119246:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789583726.316574:0:11681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfa262940 20000000:00000080:2.0:1789583726.316593:0:11681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b67b6fac00 uarg=0000000000000000 20000000:01000000:2.0:1789583726.316629:0:11681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789583726.316635:0:11681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789583726.316641:0:11681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789583726.317934:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789583726.318275:0:11681:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789583726.325766:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789583726.326139:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789583726.326348:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789583726.326368:0:11681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789583726.326388:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326406:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326414:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326421:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326431:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326438:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326459:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326494:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326509:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 12 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.326523:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332264960:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583726.326879:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.326889:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 12 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.326898:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265088:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583726.327485:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.327496:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 18 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.327506:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265216:0@lo:104: 00000100:00100000:2.0:1789583726.327559:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789583726.327600:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.327623:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 18 pid: 5842 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.327631:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265344:0@lo:104: 00000100:00100000:2.0:1789583726.327671:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789583726.327738:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.327746:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 18 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.327754:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265472:0@lo:104: 00000100:00100000:2.0:1789583726.327778:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583726.328415:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661a460c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583726.328485:0:5832:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789583726.328500:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265216 00000100:00100000:0.0:1789583726.328507:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265216 00000100:00100000:0.0:1789583726.328545:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265344 00000100:00100000:0.0:1789583726.328548:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265344 00000100:00100000:0.0:1789583726.328829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265472 00000100:00100000:0.0:1789583726.328834:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265472 00000100:00100000:0.0:1789583726.328871:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583726.328878:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:11681:x1876514332265216:12345-0@lo:104: 00010000:00010000:0.0:1789583726.328897:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.328961:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789583726.328967:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+5:11681:x1876514332265216:12345-0@lo:104: Request processed in 90us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.328974:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583726.328993:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583726.328999:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:11681:x1876514332265344:12345-0@lo:104: 00010000:00010000:0.0:1789583726.329008:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329044:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789583726.329049:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+4:11681:x1876514332265344:12345-0@lo:104: Request processed in 52us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.329055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583726.329068:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789583726.329074:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6757e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:11681:x1876514332265472:12345-0@lo:104: 00010000:00010000:0.0:1789583726.329081:0:5832:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329115:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789583726.329120:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6757e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+3:11681:x1876514332265472:12345-0@lo:104: Request processed in 48us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.329126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789583726.329175:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789583726.329187:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329194:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03c00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583726.329198:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329213:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583726.329220:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583726.329227:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789583726.329263:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329270:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583726.329291:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329298:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b645a03c00/0x6d3e73d72c6e2f14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2f1b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329311:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789583726.329314:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329320:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583726.329322:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329339:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583726.329346:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583726.329352:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789583726.329366:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329372:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583726.329379:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329386:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6756a1800/0x6d3e73d72c6e2f06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2f0d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329403:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583726.329406:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329411:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583726.329414:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329426:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583726.329432:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583726.329443:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789583726.329456:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329462:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583726.329479:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329486:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6756a0a00/0x6d3e73d72c6e2ef8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e2eff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329499:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583726.329501:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583726.329503:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583726.329510:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583726.329521:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332265600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583726.329559:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583726.329582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789583726.329588:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332265728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583726.329609:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583726.329635:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332265856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583726.329671:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583726.329703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265600 00000100:00100000:0.0:1789583726.329714:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265600 00010000:00010000:0.0:1789583726.329734:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 19 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583726.329754:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265728 00000100:00100000:0.0:1789583726.329763:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265728 00010000:00010000:0.0:1789583726.329776:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 20 pid: 5842 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583726.329787:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265856 00000100:00100000:0.0:1789583726.329789:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265856 00010000:00010000:0.0:1789583726.329798:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 21 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583726.329828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789583726.329834:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3305:x1876514332265600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583726.329850:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583726.329856:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 21 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329865:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 21 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329879:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583726.329908:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3305:x1876514332265600:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.329914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789583726.329927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789583726.329933:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3305:x1876514332265728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583726.329940:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583726.329951:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 20 pid: 5842 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329959:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 20 pid: 5842 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.329980:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583726.330003:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3305:x1876514332265728:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.330009:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789583726.330021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789583726.330028:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332265856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583726.330035:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583726.330039:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 19 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.330047:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 19 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.330055:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583726.330080:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332265856:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.330086:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789583726.330141:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332265856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583726.330164:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332265728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583726.330179:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332265600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789583726.330417:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e2f1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f14 expref: 18 pid: 5841 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.330435:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba93b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265216:0@lo:104: 00010000:00010000:2.0:1789583726.330445:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a02400/0x6d3e73d72c6e2f0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2f06 expref: 17 pid: 5842 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.330453:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265344:0@lo:104: 00010000:00010000:2.0:1789583726.330461:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a03800/0x6d3e73d72c6e2eff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e2ef8 expref: 16 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.330469:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265472:0@lo:104: 00010000:00010000:1.0:1789583726.330543:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583726.330630:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:1.0:1789583726.332381:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583726.332464:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583726.332524:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360384 00000100:00100000:0.0:1789583726.332532:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360384 00010000:00010000:0.0:1789583726.332561:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 13 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583726.332597:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360512 00000100:00100000:0.0:1789583726.332611:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360512 00010000:00010000:0.0:1789583726.332627:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 14 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583726.332680:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:3.0:1789583726.332704:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+14:2359:x1876514313360384:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583726.332727:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583726.332738:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 14 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.332756:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba91500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332264960:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583726.332758:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 14 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583726.332790:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1876514332265088:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583726.332798:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752caa00/0x6d3e73d72c6e2f29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6379 expref: 14 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.332866:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583726.332868:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583726.332954:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313360384:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 259us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.333316:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:0.0:1789583726.333330:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313360512:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583726.333346:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583726.333353:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 13 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333366:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 13 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333381:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e2f22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6372 expref: 13 pid: 5841 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333395:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333403:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333418:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333426:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333434:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333454:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333461:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583726.333466:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.333475:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.333903:0:11681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583726.333912:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.334432:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.334443:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a0400/0x6d3e73d72c6e3056 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.334461:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583726.335334:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5c501b0-a566-4083-bb80-bae594ae6290+12:2359:x1876514313360512:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 2002us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583726.335345:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789583726.336098:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000001:00080000:1.0:1789583726.686039:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:1.0:1789583726.686063:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1789583726.686069:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789583726.686101:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789583726.686109:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:0.0:1789583726.686800:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789583726.686851:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332265984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789583726.686939:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583726.687570:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332265984 00000100:00100000:3.0:1789583726.687580:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332265984 00000100:00100000:3.0:1789583726.687727:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789583726.687739:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332265984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789583726.687774:0:9665:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789583726.687851:0:9665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aaae169, atime: 0x6aaae169, ctime: 0x6aaae169, blocks: 0x1 00010000:00010000:3.0:1789583726.687861:0:9665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583726.687881:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=283s v=(0 0) 00010000:00010000:3.0:1789583726.687886:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583726.687892:0:9665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583726.687913:0:9665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583726.687924:0:9665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583726.687933:0:9665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583726.687953:0:9665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789583726.689030:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332265984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1289us (2085us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789583726.689042:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1789583726.689121:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b67b97ed80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789583726.689128:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332265984:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789583726.689464:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583726.689474:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.689487:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583726.689499:0:7652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.689512:0:7652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.689540:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.689549:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cea220/0x6d3e73d72c6e305d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583726.689577:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583726.689579:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583726.689581:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583726.689672:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789583727.143151:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789583727.398972:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789583727.398995:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b66de3b000 from 7 10000000:01000000:2.0:1789583727.399003:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789583727.399588:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.399603:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.399616:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583727.399658:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789583727.399749:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583727.401473:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661a46600 going to sleep for 11 seconds 00000100:00100000:1.0:1789583727.401778:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266112 00000100:00100000:1.0:1789583727.401790:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266112 00000100:00100000:1.0:1789583727.401893:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789583727.401904:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:5845:x1876514332266112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583727.401923:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583727.401949:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e306b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3064 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583727.402267:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e306b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3064 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583727.402283:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e306b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3064 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583727.402295:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb000, rc 0) 00000100:00100000:1.0:1789583727.402430:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332266112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 528us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583727.402438:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789583727.410696:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583727.410739:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.410755:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583727.410920:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583727.411008:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583727.411195:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661a46600 going to sleep for 11 seconds 00000100:00100000:1.0:1789583727.411629:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266240 00000100:00100000:1.0:1789583727.411695:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266240 00000100:00100000:1.0:1789583727.411842:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789583727.411854:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332266240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.412245:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332266240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 393us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583727.412254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789583727.412356:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583727.412407:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583727.412469:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583727.417185:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.417341:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266368 00000100:00100000:2.0:1789583727.417354:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266368 00000100:00100000:2.0:1789583727.417535:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789583727.417548:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332266368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583727.418157:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332266368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 608us (5683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.418166:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789583727.419991:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.424006:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11696:1876514332266496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583727.424132:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583727.424195:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba780 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.424394:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266496 00000100:00100000:2.0:1789583727.424404:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266496 00000100:00100000:2.0:1789583727.424468:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789583727.424479:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:11696:x1876514332266496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583727.424791:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:11696:x1876514332266496:12345-0@lo:502:llog_process_th.0 Request processed in 313us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.424800:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789583727.425098:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11696:1876514332266496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789583727.425141:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583727.425154:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583727.425157:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789583727.425168:0:11696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88b66de3b000 00000020:00000080:3.0:1789583727.425171:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789583727.425324:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11696:1876514332266624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583727.425375:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583727.425417:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583727.428043:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266624 00000100:00100000:0.0:1789583727.428066:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266624 00000100:00100000:0.0:1789583727.428162:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789583727.428174:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:11696:x1876514332266624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583727.428541:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644406850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:11696:x1876514332266624:12345-0@lo:502:llog_process_th.0 Request processed in 369us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583727.428549:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789583727.428966:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11696:1876514332266624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789583727.429011:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583727.429021:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583727.429024:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789583727.429041:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789583727.429309:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789583727.429338:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789583727.429351:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.429366:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583727.429378:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789583727.429392:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b64a171800 from 7 10000000:01000000:2.0:1789583727.429396:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789583727.429437:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.429446:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.429456:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583727.429482:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789583727.429535:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583727.429585:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661a469c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583727.432026:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266752 00000100:00100000:0.0:1789583727.432059:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266752 00000100:00100000:0.0:1789583727.432153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789583727.432165:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:5845:x1876514332266752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583727.432209:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583727.432232:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e3079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3072 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583727.432268:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e3079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3072 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583727.432281:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e3079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3072 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583727.432292:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca800, rc 0) 00000100:00100000:0.0:1789583727.432394:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644407850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332266752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583727.432401:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789583727.432880:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583727.432915:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583727.432928:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583727.433054:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583727.433101:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583727.433150:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.433277:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332266880 00000100:00100000:2.0:1789583727.433284:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332266880 00000100:00100000:2.0:1789583727.433318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789583727.433328:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332266880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583727.433668:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332266880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 340us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.433676:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789583727.434018:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332266880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583727.434073:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583727.434124:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583727.434161:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.434261:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267008 00000100:00100000:2.0:1789583727.434268:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267008 00000100:00100000:2.0:1789583727.434311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789583727.434321:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332267008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789583727.434515:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332267008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.434524:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789583727.436134:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583727.436448:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11697:1876514332267136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583727.436534:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583727.436575:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.436751:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267136 00000100:00100000:2.0:1789583727.436767:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267136 00000100:00100000:2.0:1789583727.436846:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789583727.436857:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:11697:x1876514332267136:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583727.437130:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b644404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:11697:x1876514332267136:12345-0@lo:502:llog_process_th.0 Request processed in 275us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.437138:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789583727.437362:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11697:1876514332267136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789583727.437390:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583727.437402:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583727.437404:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789583727.437415:0:11697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88b64a171800 00000020:00000080:3.0:1789583727.437418:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789583727.437504:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11697:1876514332267264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583727.437544:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583727.437567:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f480 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.437742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267264 00000100:00100000:2.0:1789583727.437749:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267264 00000100:00100000:2.0:1789583727.437784:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789583727.437792:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:11697:x1876514332267264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583727.438040:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:11697:x1876514332267264:12345-0@lo:502:llog_process_th.0 Request processed in 247us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.438047:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789583727.438267:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11697:1876514332267264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789583727.438288:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583727.438294:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583727.438302:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789583727.438306:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789583727.447218:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789583727.447274:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789583727.447289:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583727.447306:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583727.447319:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789583727.447323:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666645000 from 7 10000000:01000000:0.0:1789583727.447326:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789583727.447380:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583727.447390:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583727.447426:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583727.447461:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789583727.447552:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583727.447610:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692780 going to sleep for 11 seconds 00000100:00100000:2.0:1789583727.447833:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267392 00000100:00100000:2.0:1789583727.447843:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267392 00000100:00100000:2.0:1789583727.447914:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789583727.447926:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:5845:x1876514332267392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583727.447947:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583727.447964:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3087 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3080 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.448004:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3080 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.448018:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3087 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3080 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583727.448027:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0600, rc 0) 00000100:00100000:2.0:1789583727.448100:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332267392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583727.448108:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789583727.448145:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583727.448163:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583727.448173:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583727.448246:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.448278:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583727.448309:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba900 going to sleep for 11 seconds 00000100:00100000:0.0:1789583727.450016:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267520 00000100:00100000:0.0:1789583727.450033:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267520 00000100:00100000:0.0:1789583727.450120:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789583727.450135:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332267520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583727.450552:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332267520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583727.450561:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789583727.450710:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.450774:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.450848:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583727.450899:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba900 going to sleep for 11 seconds 00000100:00100000:1.0:1789583727.450917:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267648 00000100:00100000:1.0:1789583727.450921:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267648 00000100:00100000:1.0:1789583727.450954:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789583727.450961:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332267648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.451139:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:5845:x1876514332267648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583727.451146:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789583727.451187:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:5845:1876514332267648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583727.451420:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11698:1876514332267776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583727.451455:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583727.451474:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267776 00000100:00100000:1.0:1789583727.451478:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267776 00000100:00100000:1.0:1789583727.451496:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789583727.451501:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:11698:x1876514332267776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583727.451622:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:11698:x1876514332267776:12345-0@lo:502:llog_process_th.0 Request processed in 120us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583727.451630:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789583727.451670:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba780 going to sleep for 11 seconds 00000100:00100000:1.0:1789583727.451682:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11698:1876514332267776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789583727.451704:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789583727.451716:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583727.451718:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789583727.451727:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88b666645000 00000020:00000080:1.0:1789583727.451729:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789583727.451827:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11698:1876514332267904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583727.451861:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583727.451881:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332267904 00000100:00100000:1.0:1789583727.451890:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332267904 00000100:00100000:1.0:1789583727.451911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789583727.451917:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:11698:x1876514332267904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583727.452021:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:11698:x1876514332267904:12345-0@lo:502:llog_process_th.0 Request processed in 102us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583727.452028:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789583727.452053:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba780 going to sleep for 11 seconds 00000100:00100000:1.0:1789583727.452064:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:11698:1876514332267904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789583727.452081:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789583727.452086:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583727.452087:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789583727.452091:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789583727.452146:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789583727.452161:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789583727.452172:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583727.452185:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583727.501505:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789583728.170116:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583728.246132:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583728.246240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360640 00000100:00100000:2.0:1789583728.246266:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360640 00000100:00100000:2.0:1789583728.246351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 262 00000100:00100000:2.0:1789583728.246363:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+11:5599:x1876514313360640:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583728.246386:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583728.246411:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a0000/0x6d3e73d72c6e308e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583728.246450:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a0000/0x6d3e73d72c6e308e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63c6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583728.246463:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a0000/0x6d3e73d72c6e308e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63c6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583728.246474:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0000, rc 0) 00000100:00100000:2.0:1789583728.246547:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313360640:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 186us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583728.246555:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 262 00000100:00100000:1.0:1789583728.252335:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583728.256001:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360768 00000100:00100000:0.0:1789583728.256021:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360768 00000100:00100000:0.0:1789583728.256118:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 263 00000100:00100000:0.0:1789583728.256130:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313360768:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583728.256771:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313360768:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 639us (4444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583728.256780:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 263 00000100:00100000:1.0:1789583728.259056:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583728.259201:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313360896 00000100:00100000:0.0:1789583728.259213:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313360896 00000100:00100000:0.0:1789583728.259291:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 264 00000100:00100000:0.0:1789583728.259302:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313360896:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583728.259734:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313360896:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 432us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583728.259751:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 264 00000100:00100000:1.0:1789583728.270689:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583728.271364:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361024 00000100:00100000:2.0:1789583728.271380:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361024 00000100:00100000:2.0:1789583728.271464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 265 00000100:00100000:2.0:1789583728.271592:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:9968:x1876514313361024:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789583728.272753:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:9968:x1876514313361024:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 1273us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583728.272777:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 265 00000100:00100000:2.0:1789583728.288405:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583728.288662:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361152 00000100:00100000:1.0:1789583728.288676:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361152 00000100:00100000:1.0:1789583728.288748:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 266 00000100:00100000:1.0:1789583728.288759:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:9968:x1876514313361152:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583728.289123:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+12:9968:x1876514313361152:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 365us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583728.289134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 266 00000100:00100000:1.0:1789583728.301740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583728.302308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361280 00000100:00100000:2.0:1789583728.302323:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361280 00000100:00100000:2.0:1789583728.302401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 267 00000100:00100000:2.0:1789583728.302414:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+12:5599:x1876514313361280:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583728.302440:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583728.302465:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1000/0x6d3e73d72c6e3095 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63cd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583728.302514:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1000/0x6d3e73d72c6e3095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63cd expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583728.302526:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1000/0x6d3e73d72c6e3095 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63cd expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583728.302536:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1000, rc 0) 00000100:00100000:2.0:1789583728.302620:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313361280:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 209us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583728.302629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 267 00000100:00100000:3.0:1789583728.310726:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583728.310835:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361408 00000100:00100000:0.0:1789583728.310847:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361408 00000100:00100000:0.0:1789583728.310907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 268 00000100:00100000:0.0:1789583728.310917:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313361408:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583728.311281:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313361408:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 365us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583728.311287:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 268 00000100:00100000:3.0:1789583728.313572:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583728.313710:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361536 00000100:00100000:1.0:1789583728.313722:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361536 00000100:00100000:1.0:1789583728.313893:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 269 00000100:00100000:1.0:1789583728.313905:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313361536:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583728.314196:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:5599:x1876514313361536:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 292us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583728.314205:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 269 00000100:00100000:1.0:1789583728.317496:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583728.317697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361664 00000100:00100000:2.0:1789583728.317713:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361664 00000100:00100000:2.0:1789583728.317883:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 270 00000100:00100000:2.0:1789583728.317895:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:9971:x1876514313361664:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789583728.318222:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:9971:x1876514313361664:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 327us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583728.318241:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 270 00000100:00100000:3.0:1789583728.321322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583728.321447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361792 00000100:00100000:1.0:1789583728.321460:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361792 00000100:00100000:1.0:1789583728.321528:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 271 00000100:00100000:1.0:1789583728.321540:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:9971:x1876514313361792:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583728.321900:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:9971:x1876514313361792:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 360us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583728.321909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 271 00000040:00080000:2.0:1789583728.551461:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789583729.191319:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332268416:0@lo:400:kworker.0 00000100:00100000:0.0:1789583729.191414:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583729.191490:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583729.191497:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332268288:0@lo:400:kworker.0 00000100:00100000:0.0:1789583729.191524:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583729.191566:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268288 00000100:00100000:0.0:1789583729.191574:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268288 00000100:00100000:0.0:1789583729.191654:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789583729.191667:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332268288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583729.191770:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268416 00000100:00100000:3.0:1789583729.191775:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268416 00000100:00100000:3.0:1789583729.191833:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789583729.191841:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876514332268416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.191959:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332268032:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583729.192026:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332268544:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192047:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583729.192073:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789583729.192079:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332268160:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192102:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583729.192119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332268672:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192139:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583729.192164:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268544 00000100:00100000:2.0:1789583729.192168:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268544 00000100:00100000:2.0:1789583729.192187:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268160 00000100:00100000:2.0:1789583729.192190:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268160 00000100:00100000:2.0:1789583729.192207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789583729.192213:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332268544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192251:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332268544:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583729.192258:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789583729.192279:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789583729.192285:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332268160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192312:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332268160:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583729.192319:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789583729.192391:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332268160:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192402:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332268544:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192428:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268032 00000100:00100000:2.0:1789583729.192431:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268032 00000100:00100000:2.0:1789583729.192459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789583729.192466:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332268032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.192501:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332268032:12345-0@lo:400:kworker.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583729.192507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789583729.192539:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332268032:0@lo:400:kworker.0 00000100:00080000:1.0:1789583729.192686:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583729.192694:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583729.192701:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332268288:12345-0@lo:400:kworker.0 Request processed in 1035us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583729.192710:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00010000:0.0:1789583729.192793:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583729.193273:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268672 00000100:00100000:0.0:1789583729.193285:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268672 00000100:00100000:0.0:1789583729.193330:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789583729.193338:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332268672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583729.193403:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332268672:12345-0@lo:400:kworker.0 Request processed in 66us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583729.193411:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789583729.193437:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332268800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583729.193471:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789583729.193517:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b64a1dca80 x1876514332268672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583729.193531:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332268672:0@lo:400:kworker.0 00000100:00080000:0.0:1789583729.193553:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583729.193582:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268800 00000100:00100000:0.0:1789583729.193585:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268800 00000100:00100000:0.0:1789583729.193609:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789583729.193615:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876514332268800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583729.193662:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583729.193703:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876514332268800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583729.193710:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789583729.193758:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332268800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583729.196890:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876514332268416:12345-0@lo:400:kworker.0 Request processed in 5037us (5463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583729.196908:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789583729.202298:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332268288:0@lo:400:kworker.0 00000100:00100000:1.0:1789583729.202341:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332268416:0@lo:400:kworker.0 00000100:00100000:2.0:1789583729.706213:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583729.706241:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332268928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583729.706309:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583729.706437:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332268928 00000100:00100000:0.0:1789583729.706445:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332268928 00000100:00100000:0.0:1789583729.706498:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789583729.706507:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332268928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583729.706540:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583729.706591:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332268928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583729.706613:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789583729.706742:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880e00 x1876514332268928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583729.706785:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332268928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583730.215198:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583730.238219:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583730.238262:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583730.238300:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583730.238327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583730.238508:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362048 00000100:00100000:3.0:1789583730.238518:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362048 00000100:00100000:3.0:1789583730.238584:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362304 00000100:00100000:3.0:1789583730.238587:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362304 00000100:00100000:3.0:1789583730.238611:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:3.0:1789583730.238631:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313362048:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583730.238695:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362176 00000100:00100000:0.0:1789583730.238709:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362176 00000100:00080000:2.0:1789583730.238729:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583730.238738:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583730.238777:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:2.0:1789583730.238792:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313362304:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583730.238802:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583730.238855:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313362176:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583730.238918:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313362304:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 130us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583730.238926:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:0.0:1789583730.238949:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313362176:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 96us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583730.238963:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583730.239013:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313361920 00000100:00100000:0.0:1789583730.239018:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313361920 00000100:00100000:0.0:1789583730.239066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 273 00000100:00100000:0.0:1789583730.239075:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313361920:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583730.242519:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d91c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313361920:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 3426us (4198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583730.242540:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 273 00000100:00100000:3.0:1789583730.242658:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313362048:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 4027us (4448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583730.242674:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 98 00010000:00010000:1.0:1789583731.239226:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789583731.794930:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1789583732.263020:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583733.287041:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583734.313119:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583734.313341:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332269184:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313430:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583734.313511:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332269696:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313542:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583734.313574:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789583734.313581:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332269056:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313621:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583734.313642:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332269568:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313662:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583734.313685:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332269312:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313705:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583734.313722:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583734.313726:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332269440:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313745:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583734.313777:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269056 00000100:00100000:1.0:1789583734.313786:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269056 00000100:00100000:1.0:1789583734.313870:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789583734.313881:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332269056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.313940:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332269056:12345-0@lo:400:kworker.0 Request processed in 61us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583734.313948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789583734.313984:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269184 00000100:00100000:1.0:1789583734.314004:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269184 00000100:00100000:1.0:1789583734.314027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269568 00000100:00100000:1.0:1789583734.314030:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269568 00000100:00100000:1.0:1789583734.314048:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269312 00000100:00100000:1.0:1789583734.314050:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269312 00000100:00100000:1.0:1789583734.314066:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789583734.314071:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332269184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.314102:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332269184:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583734.314109:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789583734.314120:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789583734.314126:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332269568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.314150:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332269568:12345-0@lo:400:kworker.0 Request processed in 24us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583734.314156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789583734.314165:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789583734.314171:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332269312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.314200:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332269312:12345-0@lo:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583734.314205:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789583734.314244:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332269312:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.314272:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332269056:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.314282:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332269568:0@lo:400:kworker.0 00000100:00100000:1.0:1789583734.314291:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332269184:0@lo:400:kworker.0 00000100:00100000:3.0:1789583734.314383:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269696 00000100:00100000:3.0:1789583734.314387:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269696 00000100:00100000:3.0:1789583734.314423:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269440 00000100:00100000:3.0:1789583734.314427:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269440 00000100:00100000:3.0:1789583734.314448:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789583734.314455:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332269696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583734.314507:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332269696:12345-0@lo:400:kworker.0 Request processed in 53us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583734.314514:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789583734.314528:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789583734.314535:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332269440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583734.314567:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332269440:12345-0@lo:400:kworker.0 Request processed in 33us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583734.314573:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789583734.314611:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789583734.314618:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b67b97ed80, transno 4294967300 00000100:00100000:3.0:1789583734.314627:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332269440:0@lo:400:kworker.0 00010000:00080000:3.0:1789583734.314650:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752a1180 x1876514332269696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583734.314663:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332269696:0@lo:400:kworker.0 00000100:00080000:2.0:1789583734.315471:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583734.315477:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583734.315481:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583734.315553:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332269824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583734.315685:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583734.315777:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269824 00000100:00100000:2.0:1789583734.315783:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269824 00000100:00100000:2.0:1789583734.315851:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789583734.315861:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332269824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583734.315891:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583734.315936:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332269824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583734.315944:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789583734.316031:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332269824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583734.823403:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332269952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583734.823503:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583734.831144:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332269952 00000100:00100000:2.0:1789583734.831177:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332269952 00000100:00100000:2.0:1789583734.831276:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789583734.831290:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332269952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583734.831346:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583734.831469:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332269952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (7966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583734.831477:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789583734.831765:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b648880e00 x1876514332269952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583734.831793:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b648880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332269952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583735.335015:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583735.356117:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583735.356168:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583735.356201:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583735.356360:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362560 00000100:00100000:3.0:1789583735.356374:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362560 00000100:00100000:3.0:1789583735.356455:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362816 00000100:00100000:3.0:1789583735.356459:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362816 00000100:00100000:3.0:1789583735.356487:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:3.0:1789583735.356498:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313362560:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583735.356611:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313362560:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 115us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583735.356634:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:0.0:1789583735.356653:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362432 00000100:00100000:3.0:1789583735.356657:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:0.0:1789583735.356661:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362432 00000100:00100000:3.0:1789583735.356667:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313362816:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583735.356697:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313362816:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583735.356706:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:0.0:1789583735.356707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 275 00000100:00100000:0.0:1789583735.356720:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313362432:12345-192.168.203.46@tcp:400:kworker.0 00000100:00080000:3.0:1789583735.356749:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583735.356767:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313362432:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 51us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583735.356786:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 275 00000100:00100000:2.0:1789583735.356854:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583735.356890:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362688 00000100:00100000:0.0:1789583735.356894:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362688 00000100:00100000:0.0:1789583735.356940:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:0.0:1789583735.356948:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313362688:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583735.356979:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313362688:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 33us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583735.356986:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00080000:2.0:1789583735.357106:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789583736.359036:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583737.384497:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583738.407049:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583738.792130:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789583739.431315:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332270080:0@lo:400:kworker.0 00000100:00100000:3.0:1789583739.431420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583739.431488:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332270592:0@lo:400:kworker.0 00000100:00100000:1.0:1789583739.431498:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332270208:0@lo:400:kworker.0 00000100:00100000:3.0:1789583739.431518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583739.431584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270080 00000100:00100000:2.0:1789583739.431596:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270080 00000100:00100000:0.0:1789583739.431602:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332270336:0@lo:400:kworker.0 00000100:00100000:1.0:1789583739.431627:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332270464:0@lo:400:kworker.0 00000100:00100000:2.0:1789583739.431660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789583739.431671:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332270080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.438530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583739.438605:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332270848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583739.438648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583739.438727:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270592 00000100:00100000:0.0:1789583739.438738:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270592 00000100:00100000:0.0:1789583739.438820:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270336 00000100:00100000:0.0:1789583739.438824:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270336 00000100:00100000:0.0:1789583739.438867:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789583739.438877:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332270592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.438934:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332270592:12345-0@lo:400:kworker.0 Request processed in 58us (7415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.438940:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789583739.438958:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789583739.438963:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332270336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.439015:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332270336:12345-0@lo:400:kworker.0 Request processed in 52us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.439022:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789583739.439040:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270848 00000100:00100000:0.0:1789583739.439043:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270848 00000100:00100000:0.0:1789583739.439068:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789583739.439074:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332270848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583739.439110:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583739.439140:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332270848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.439146:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1789583739.439161:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789583739.439166:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789583739.439240:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583739.439277:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332270336:0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.439298:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332270848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583739.439446:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583739.439474:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332270720:0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.439500:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583739.439526:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270720 00000100:00100000:0.0:1789583739.439529:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270720 00000100:00100000:0.0:1789583739.439570:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789583739.439577:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332270720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.439609:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332270720:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.439615:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789583739.439635:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789583739.439651:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97f480 x1876514332270720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583739.439663:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332270720:0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.439675:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270208 00000100:00100000:0.0:1789583739.439678:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270208 00000100:00100000:0.0:1789583739.439694:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789583739.439699:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332270208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.439727:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332270208:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.439733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789583739.439754:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332270208:0@lo:400:kworker.0 00000100:00100000:1.0:1789583739.445137:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583739.445216:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270464 00000100:00100000:0.0:1789583739.445231:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270464 00000100:00100000:0.0:1789583739.445301:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789583739.445312:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332270464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583739.456364:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332270464:12345-0@lo:400:kworker.0 Request processed in 11039us (11224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.456386:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789583739.456522:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332270080:12345-0@lo:400:kworker.0 Request processed in 24850us (25099us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583739.456533:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789583739.456675:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332270592:0@lo:400:kworker.0 00000100:00100000:3.0:1789583739.456718:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332270080:0@lo:400:kworker.0 00000100:00100000:1.0:1789583739.460755:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332270464:0@lo:400:kworker.0 00000100:00100000:2.0:1789583739.946306:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583739.946339:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332270976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583739.946434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583739.947129:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332270976 00000100:00100000:0.0:1789583739.947141:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332270976 00000100:00100000:0.0:1789583739.947207:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789583739.947219:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332270976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583739.947268:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583739.947338:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332270976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583739.947365:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789583739.947456:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67af5d180 x1876514332270976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583739.947478:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332270976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789583740.455164:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583740.468921:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583740.468983:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583740.469031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583740.469071:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583740.469226:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363072 00000100:00100000:0.0:1789583740.469240:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363072 00000100:00100000:2.0:1789583740.469304:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313362944 00000100:00100000:2.0:1789583740.469308:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313362944 00000100:00100000:0.0:1789583740.469316:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363328 00000100:00100000:0.0:1789583740.469319:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363328 00000100:00100000:2.0:1789583740.469344:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 277 00000100:00100000:0.0:1789583740.469344:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:2.0:1789583740.469354:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313362944:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583740.469354:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313363072:12345-192.168.203.46@tcp:400:kworker.0 00000100:00080000:3.0:1789583740.469430:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583740.469469:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 109 00000100:00100000:3.0:1789583740.469478:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313363328:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583740.469557:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363200 00000100:00100000:1.0:1789583740.469561:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363200 00000100:00100000:1.0:1789583740.469605:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:1.0:1789583740.469612:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313363200:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583740.469693:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313362944:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 339us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583740.469701:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 277 00000100:00080000:2.0:1789583740.469902:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583740.478802:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313363072:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 9431us (9876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583740.478831:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:3.0:1789583740.482364:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313363328:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 12870us (13363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583740.482708:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313363200:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 13094us (13633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583740.482725:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:3.0:1789583740.482780:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 109 00010000:00010000:0.0:1789583741.481958:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583742.503013:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583743.527151:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583744.551009:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583744.551475:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332271104:0@lo:400:kworker.0 00000100:00100000:3.0:1789583744.551562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583744.551610:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332271616:0@lo:400:kworker.0 00000100:00100000:3.0:1789583744.551634:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583744.551659:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789583744.551665:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332271232:0@lo:400:kworker.0 00000100:00100000:3.0:1789583744.551802:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583744.551849:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332271744:0@lo:400:kworker.0 00000100:00100000:3.0:1789583744.551876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583744.551893:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332271360:0@lo:400:kworker.0 00000100:00100000:3.0:1789583744.551910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271104 00000100:00100000:3.0:1789583744.551918:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271104 00000100:00100000:3.0:1789583744.551963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789583744.551972:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332271104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.551992:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583744.552017:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583744.552036:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332271104:12345-0@lo:400:kworker.0 Request processed in 64us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583744.552044:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789583744.552049:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583744.552085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271616 00000100:00100000:3.0:1789583744.552090:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271616 00000100:00100000:2.0:1789583744.552104:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271232 00000100:00100000:2.0:1789583744.552110:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271232 00000100:00100000:2.0:1789583744.552143:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271360 00000100:00100000:3.0:1789583744.552148:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789583744.552260:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271744 00000100:00100000:0.0:1789583744.552264:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271744 00000100:00100000:0.0:1789583744.552296:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789583744.552303:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332271744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583744.552337:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332271744:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583744.552344:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789583744.552374:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789583744.552382:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332271616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.552395:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271360 00000100:00100000:0.0:1789583744.552412:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332271616:12345-0@lo:400:kworker.0 Request processed in 32us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583744.552418:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789583744.552437:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271872 00000100:00100000:0.0:1789583744.552462:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271872 00000100:00100000:0.0:1789583744.552502:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789583744.552508:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789583744.552520:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332271872:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583744.552531:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332271360:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789583744.552553:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583744.552582:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332271360:12345-0@lo:400:kworker.0 Request processed in 54us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583744.552590:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789583744.552604:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332271872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583744.552611:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789583744.552633:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332271360:0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.552657:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332271872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789583744.552659:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789583744.552664:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789583744.552667:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789583744.552710:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752a1500 x1876514332271744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583744.552720:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332271744:0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.552730:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332271104:0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.552738:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332271616:0@lo:400:kworker.0 00000100:00100000:1.0:1789583744.552866:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332271488:0@lo:400:kworker.0 00000100:00100000:1.0:1789583744.552896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583744.554300:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332271488 00000100:00100000:2.0:1789583744.554312:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332271488 00000100:00100000:2.0:1789583744.554429:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789583744.554441:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332271488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.554631:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332271488:12345-0@lo:400:kworker.0 Request processed in 192us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583744.554639:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789583744.554765:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332271232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583744.554830:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332271232:12345-0@lo:400:kworker.0 Request processed in 2674us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583744.554838:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789583744.554936:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332271488:0@lo:400:kworker.0 00000100:00100000:2.0:1789583744.555003:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332271232:0@lo:400:kworker.0 00000100:00100000:3.0:1789583745.063065:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583745.063090:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332272000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583745.063173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583745.063462:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272000 00000100:00100000:1.0:1789583745.063470:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272000 00000100:00100000:1.0:1789583745.063528:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789583745.063538:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332272000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789583745.063589:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583745.063652:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332272000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583745.063661:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789583745.063750:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67b97e680 x1876514332272000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583745.063768:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b97e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332272000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583745.575085:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583745.590203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583745.590249:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583745.590266:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363456 00000100:00100000:0.0:1789583745.590277:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363456 00000100:00100000:0.0:1789583745.590388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 279 00000100:00100000:0.0:1789583745.590400:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2360:x1876514313363456:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583745.590439:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363584 00000100:00100000:1.0:1789583745.590445:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363584 00000100:00100000:0.0:1789583745.590472:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2360:x1876514313363456:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 74us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583745.590481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 279 00000100:00100000:1.0:1789583745.590491:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:1.0:1789583745.590511:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313363584:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583745.590547:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2360:x1876514313363584:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583745.590555:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00080000:1.0:1789583745.590591:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583745.598297:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583745.598518:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363712 00000100:00100000:0.0:1789583745.598528:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363712 00000100:00100000:0.0:1789583745.598660:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:0.0:1789583745.598670:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2357:x1876514313363712:12345-192.168.203.46@tcp:9:kworker.0 00000020:00000080:0.0:1789583745.598701:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2fd1 00000100:00080000:0.0:1789583745.598710:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b644561800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789583745.598749:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789583745.599048:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+2:2357:x1876514313363712:12345-192.168.203.46@tcp:9:kworker.0 Request processed in 379us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583745.599066:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583745.599271:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583745.599477:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363840 00000100:00100000:0.0:1789583745.599483:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363840 00010000:00010000:3.0:1789583745.599592:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583745.599933:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583745.599938:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583745.600533:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:0.0:1789583745.600544:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313363840:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583745.600609:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313363840:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 68us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583745.600616:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 114 00010000:00010000:0.0:1789583746.599910:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583747.159213:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:3.0:1789583747.159221:0:6732:0:(genops.c:885:class_export_put()) final put ffff88b644567000/768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:2.0:1789583747.159323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b644567000/768b736a-7b4a-4614-9d07-b155a4183a8a for lustre-OST0000 00000020:00000080:2.0:1789583747.159374:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b644561800 for lustre-OST0000 00010000:00010000:0.0:1789583747.622971:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789583748.009412:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789583748.647209:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583749.671051:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332272256:0@lo:400:kworker.0 00000100:00100000:2.0:1789583749.671052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332272512:0@lo:400:kworker.0 00000100:00100000:3.0:1789583749.671103:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332272384:0@lo:400:kworker.0 00000100:00100000:1.0:1789583749.671224:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583749.671226:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332272128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583749.671264:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583749.671270:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332272768:0@lo:400:kworker.0 00000100:00100000:0.0:1789583749.671284:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332272640:0@lo:400:kworker.0 00000100:00100000:1.0:1789583749.671292:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583749.671301:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583749.671364:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272128 00000100:00100000:0.0:1789583749.671372:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272128 00000100:00100000:1.0:1789583749.671387:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272768 00000100:00100000:1.0:1789583749.671390:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272768 00000100:00100000:1.0:1789583749.671420:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789583749.671420:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789583749.671428:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332272768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583749.671428:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332272128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583749.671459:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583749.671484:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332272768:12345-0@lo:400:kworker.0 Request processed in 46us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583749.671491:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789583749.671533:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332272768:0@lo:400:kworker.0 00000100:00080000:1.0:1789583749.671574:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583749.671579:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789583749.671586:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583749.671595:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272640 00000100:00100000:1.0:1789583749.671599:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272640 00000100:00100000:1.0:1789583749.671624:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789583749.671630:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332272640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583749.672149:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332272128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 721us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583749.672157:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789583749.672172:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332272640:12345-0@lo:400:kworker.0 Request processed in 542us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583749.672178:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789583749.672195:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332272128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583749.672244:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332272640:0@lo:400:kworker.0 00000100:00100000:3.0:1789583749.673244:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583749.673307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272256 00000100:00100000:2.0:1789583749.673321:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272256 00000100:00100000:2.0:1789583749.673363:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789583749.673371:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332272256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583749.673420:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332272256:12345-0@lo:400:kworker.0 Request processed in 50us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583749.673428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789583749.673482:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332272256:0@lo:400:kworker.0 00000100:00100000:3.0:1789583749.673615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332272896:0@lo:400:kworker.0 00000100:00100000:3.0:1789583749.673645:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583749.675092:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272896 00000100:00100000:0.0:1789583749.675103:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272896 00000100:00100000:0.0:1789583749.675167:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789583749.675176:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332272896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583749.675243:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332272896:12345-0@lo:400:kworker.0 Request processed in 69us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583749.675249:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1789583749.675273:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789583749.675302:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752eb800 x1876514332272896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789583765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583749.675326:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332272896:0@lo:400:kworker.0 00000100:00100000:2.0:1789583749.676099:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583749.686413:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272384 00000100:00100000:1.0:1789583749.686426:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272384 00000100:00100000:1.0:1789583749.686497:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332272512 00000100:00100000:1.0:1789583749.686501:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332272512 00000100:00100000:1.0:1789583749.686541:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789583749.686550:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332272384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583749.686640:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332272384:12345-0@lo:400:kworker.0 Request processed in 91us (13399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583749.686647:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789583749.686664:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789583749.686670:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332272512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583749.686707:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332272512:12345-0@lo:400:kworker.0 Request processed in 38us (10611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583749.686713:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1789583749.686735:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583749.686771:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332272384:0@lo:400:kworker.0 00000100:00100000:3.0:1789583749.688109:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332272512:0@lo:400:kworker.0 00000001:02000400:1.0:1789583749.731204:0:11866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:35:48 (1789583748) 00000100:00100000:3.0:1789583750.183338:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332273024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583750.183465:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583750.186845:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332273024 00000100:00100000:0.0:1789583750.186860:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332273024 00000100:00100000:0.0:1789583750.186936:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789583750.186946:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332273024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583750.186985:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583750.187078:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332273024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (3656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583750.187085:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789583750.187863:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6752e8380 x1876514332273024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583750.187888:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332273024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789583750.696119:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583750.713314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583750.713426:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313363968 00000100:00100000:2.0:1789583750.713437:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313363968 00000100:00100000:2.0:1789583750.713507:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 281 00000100:00100000:2.0:1789583750.713517:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313363968:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583750.713595:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313363968:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 79us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583750.713603:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 281 00000100:00100000:2.0:1789583750.719679:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583750.719720:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583750.719832:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364096 00000100:00100000:3.0:1789583750.719843:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364096 00000100:00100000:3.0:1789583750.719910:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364224 00000100:00100000:3.0:1789583750.719914:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364224 00000100:00100000:3.0:1789583750.719936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789583750.719961:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313364096:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583750.720028:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313364096:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 70us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583750.720036:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789583750.720167:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:3.0:1789583750.720175:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313364224:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583750.720273:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313364224:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 98us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583750.720280:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00080000:0.0:1789583750.720442:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583751.284509:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583751.286475:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364352 00000100:00100000:1.0:1789583751.286490:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364352 00000100:00100000:1.0:1789583751.287312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:1.0:1789583751.287323:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:10240:x1876514313364352:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583751.287343:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583751.287366:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e309c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63d4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583751.287429:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e30a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583751.287443:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e30a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583751.287456:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e30a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583751.287525:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789583751.287530:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583751.287575:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e30a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583751.287602:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e309c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63d4 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583751.287622:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e30a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63d4 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583751.288019:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583751.288021:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583751.288024:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa400, rc 0) 00000100:00100000:1.0:1789583751.288087:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:10240:x1876514313364352:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 765us (3588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583751.288094:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:0.0:1789583751.294262:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583751.294388:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364480 00000100:00100000:2.0:1789583751.294398:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364480 00000100:00100000:2.0:1789583751.294524:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:2.0:1789583751.294564:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:10241:x1876514313364480:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583751.294585:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583751.294605:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e30aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63db expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294681:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294697:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294708:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294723:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294730:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294737:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294990:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e30bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.294999:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e30bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295007:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e30bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583751.295054:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789583751.295058:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583751.295090:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e30bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295099:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295105:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295112:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295117:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583751.295121:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295127:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295138:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583751.295140:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583751.295145:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295151:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e30b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295163:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295179:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295185:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295189:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583751.295192:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295198:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295205:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88b6583d4700) 00010000:00010000:2.0:1789583751.295208:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583751.295211:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295217:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e30b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295248:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e30aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63db expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295262:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e30bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63db expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583751.295270:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88b6583d4100) 00010000:00010000:2.0:1789583751.295272:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583751.295281:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1c00, rc 0) 00000100:00100000:2.0:1789583751.295347:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:10241:x1876514313364480:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 785us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583751.295354:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:2.0:1789583751.298374:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583751.298451:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364736 00000100:00100000:3.0:1789583751.298471:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364736 00000100:00100000:3.0:1789583751.298550:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789583751.298562:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:10241:x1876514313364736:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583751.298582:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583751.298602:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e30c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63e2 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.298685:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.298700:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.298711:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.298787:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.298795:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.298802:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299171:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02400/0x6d3e73d72c6e30db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299180:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02400/0x6d3e73d72c6e30db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299187:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02400/0x6d3e73d72c6e30db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583751.299195:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789583751.299339:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299346:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299352:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299357:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583751.299361:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299378:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299392:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88b6583d4100) 00010000:00010000:3.0:1789583751.299395:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583751.299400:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299406:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e30cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299419:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299425:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299431:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299436:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583751.299440:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299446:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299453:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88b64336a100) 00010000:00010000:3.0:1789583751.299456:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583751.299459:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299488:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299973:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e30c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63e2 expref: 10 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299990:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02400/0x6d3e73d72c6e30db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63e2 expref: 9 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583751.299997:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:3.0:1789583751.299999:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583751.300002:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02400, rc 0) 00000100:00100000:3.0:1789583751.300061:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10241:x1876514313364736:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1501us (1695us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789583751.300069:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:3.0:1789583751.304475:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583751.304637:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364864 00000100:00100000:1.0:1789583751.304648:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364864 00000100:00100000:1.0:1789583751.304707:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:1.0:1789583751.304717:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10241:x1876514313364864:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789583751.304858:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10241:x1876514313364864:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 142us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583751.304866:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00010000:00010000:3.0:1789583751.720497:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789583752.104422:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1789583752.307512:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1789583752.742988:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583753.242927:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.242993:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313364992 00000100:00100000:3.0:1789583753.243004:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313364992 00000100:00080000:0.0:1789583753.243128:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583753.243141:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789583753.243152:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+8:10283:x1876514313364992:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583753.243172:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583753.243191:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e30e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63e9 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243274:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243289:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243303:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243319:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243326:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243332:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243524:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243532:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243538:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243544:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.243548:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243565:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243577:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583753.243580:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.243585:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243591:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e30f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243602:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243608:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243613:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243618:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.243620:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243625:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243632:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88b64336a500) 00010000:00010000:3.0:1789583753.243634:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.243636:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243650:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e30f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243681:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e30e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63e9 expref: 9 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243692:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583753.243694:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.243697:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e30e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63e9 expref: 9 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.243706:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03000, rc 0) 00000100:00100000:3.0:1789583753.243773:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+8:10283:x1876514313364992:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 623us (855us total) trans 0 rc 301/301 00000100:00100000:3.0:1789583753.243779:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789583753.250207:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.251638:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313365248 00000100:00100000:1.0:1789583753.251649:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313365248 00000100:00100000:1.0:1789583753.251702:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:1.0:1789583753.251710:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:10283:x1876514313365248:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:1.0:1789583753.251760:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583753.251782:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e30a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63d4 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.251799:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583753.251827:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583753.252024:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252037:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252047:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252056:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252063:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252069:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583753.252932:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789583753.252944:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252952:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252958:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252963:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583753.252967:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252974:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.252994:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b645246200) 00010000:00010000:1.0:1789583753.252997:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583753.253001:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.253008:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e30fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583753.253025:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bacf2c89 reply state 000000003c4b2d7f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.253034:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583753.253164:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10283:x1876514313365248:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 1452us (2965us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789583753.253173:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00010000:00010000:3.0:1789583753.266631:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.266646:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.266655:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.266661:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.266666:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.266687:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.266704:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88b645246d00) 00010000:00010000:3.0:1789583753.266707:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.266713:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.266719:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3105 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583753.328540:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583753.328674:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313365376 00000100:00100000:0.0:1789583753.328684:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313365376 00000100:00100000:0.0:1789583753.328789:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:0.0:1789583753.328800:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67509d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+8:10291:x1876514313365376:12345-192.168.203.46@tcp:101:lctl.0 00010000:00010000:0.0:1789583753.328881:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583753.328905:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e310c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63f0 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.328973:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3113 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.328987:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.329000:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583753.329035:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789583753.329040:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583753.329262:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3113 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.329286:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e310c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63f0 expref: 10 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.329305:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3113 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63f0 expref: 9 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.329313:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583753.329317:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583753.329321:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752caa00, rc 0) 00000100:00100000:0.0:1789583753.329439:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67509d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10291:x1876514313365376:12345-192.168.203.46@tcp:101:lctl.0 Request processed in 640us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583753.329455:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789583753.382142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.382307:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313365504 00000100:00100000:2.0:1789583753.382318:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313365504 00000100:00100000:2.0:1789583753.382371:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:2.0:1789583753.382382:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10297:x1876514313365504:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583753.382401:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583753.382422:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e311a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63f7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.382510:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.382525:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.382535:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.382795:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.383662:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.383678:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.383880:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e312f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.383889:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e312f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.383896:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e312f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583753.383924:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789583753.383927:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583753.383963:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e312f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.383974:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.383994:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384010:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384015:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.384019:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384026:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384038:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583753.384048:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.384053:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384058:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384071:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384076:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384081:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384086:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.384089:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384103:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384111:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88b6583d4700) 00010000:00010000:3.0:1789583753.384113:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.384116:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384121:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384156:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e311a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63f7 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384168:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e312f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63f7 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.384174:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583753.384176:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789583753.384178:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03000, rc 0) 00000100:00100000:3.0:1789583753.384253:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+10:10297:x1876514313365504:12345-192.168.203.46@tcp:101:bash.0 Request processed in 1872us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583753.384261:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:1.0:1789583753.389545:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.389639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313365760 00000100:00100000:3.0:1789583753.389649:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313365760 00000100:00100000:3.0:1789583753.389706:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789583753.389716:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+10:10297:x1876514313365760:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789583753.389753:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583753.389773:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3136 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec63fe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.390224:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.390239:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.390251:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.390266:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.390273:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.390280:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789583753.391655:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789583753.391891:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391904:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391914:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391961:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391968:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391975:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391981:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.391985:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.391993:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.392004:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583753.392007:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.392012:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.392019:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e313d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583753.392044:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d51b4767 reply state 000000009c86278d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583753.392053:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789583753.392089:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3136 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.392115:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.392122:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:3.0:1789583753.392129:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583753.392131:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03400, rc 0) 00000100:00100000:3.0:1789583753.392207:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10297:x1876514313365760:12345-192.168.203.46@tcp:101:bash.0 Request processed in 2492us (2670us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789583753.392215:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00010000:00010000:3.0:1789583753.396326:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.396345:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.396353:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.396359:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.396364:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.396372:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.396389:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b64336ab00) 00010000:00010000:3.0:1789583753.396392:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.396396:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.396417:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3144 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.401032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.401343:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313365888 00000100:00100000:2.0:1789583753.401354:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313365888 00000100:00100000:2.0:1789583753.401405:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:2.0:1789583753.401414:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1876514313365888:12345-192.168.203.46@tcp:8:bash.0 00010000:00080000:2.0:1789583753.401456:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:2.0:1789583753.401490:0:6705:0:(genops.c:1384:class_connect()) connect: client 768b736a-7b4a-4614-9d07-b155a4183a8a, cookie 0x6d3e73d72c6e3159 00002000:00100000:2.0:1789583753.401501:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 768b736a-7b4a-4614-9d07-b155a4183a8a/ffff88b644567000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789583753.401526:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789583753.401747:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789583753.402943:0:6705:0:(import.c:65:import_set_state_nolock()) ffff88b644562000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583753.403110:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2357:x1876514313365888:12345-192.168.203.46@tcp:8:bash.0 Request processed in 1693us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583753.403121:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:0.0:1789583753.410352:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.410461:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313366016 00000100:00100000:2.0:1789583753.410473:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313366016 00000100:00100000:2.0:1789583753.410648:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:2.0:1789583753.410660:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:0:x1876514313366016:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583753.410679:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583753.410702:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6405 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789583753.410730:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789583753.410748:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1789583753.410752:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583753.410794:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.410849:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.410865:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0a00, rc 0) 00000100:00100000:2.0:1789583753.410916:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:0:x1876514313366016:12345-192.168.203.46@tcp:101:bash.0 Request processed in 259us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583753.410923:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00080000:0.0:1789583753.412050:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583753.416493:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.416592:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313366144 00000100:00100000:2.0:1789583753.416602:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313366144 00000100:00100000:2.0:1789583753.416662:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:2.0:1789583753.416672:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:10297:x1876514313366144:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583753.416691:0:9665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583753.416709:0:9665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec640c expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.416739:0:9665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.416748:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583753.416751:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583753.416757:0:9665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 8 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.416794:0:9665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.416942:0:9665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 8 pid: 6702 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583753.416955:0:9665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9665:1876514332273152:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583753.417097:0:9665:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a0629c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583753.422371:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583753.422881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313366272 00000100:00100000:0.0:1789583753.422891:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313366272 00010000:00010000:0.0:1789583753.422931:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 9 pid: 6702 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583753.422978:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:0.0:1789583753.422988:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313366272:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583753.423001:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583753.423024:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 9 pid: 6702 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.423038:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 9 pid: 6702 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.423076:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583753.423080:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583753.423089:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.423099:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.423136:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583753.423170:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1876514332273280:192.168.203.46@tcp:105: 00000100:00100000:0.0:1789583753.423257:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b676ce0cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789583753.425427:0:9665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f63175b/0x6d3e73d72c6e3160 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6405 expref: 9 pid: 6702 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.425568:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1876514332273280:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789583753.425591:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583753.425639:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313366272:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 2653us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583753.425648:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:2.0:1789583753.426080:0:9665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9665:1876514332273152:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583753.426102:0:9665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 7 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.426306:0:9665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1600, rc 0) 00000100:00100000:2.0:1789583753.426342:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:10297:x1876514313366144:12345-192.168.203.46@tcp:101:bash.0 Request processed in 9672us (9858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583753.426349:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:0.0:1789583753.429424:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.429481:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313366528 00000100:00100000:2.0:1789583753.429492:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313366528 00000100:00100000:2.0:1789583753.429547:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789583753.429557:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+12:10297:x1876514313366528:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789583753.429931:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10297:x1876514313366528:12345-192.168.203.46@tcp:35:bash.0 Request processed in 375us (514us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789583753.429941:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:3.0:1789583753.502781:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.503224:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313366784 00000100:00100000:1.0:1789583753.503234:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313366784 00000100:00100000:1.0:1789583753.503322:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789583753.503332:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10307:x1876514313366784:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583753.503368:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583753.503388:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e316e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6413 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583753.503487:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789583753.503605:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e316e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6413 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.503619:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583753.503623:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583753.503628:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e316e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6413 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.503641:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfbc00, rc 0) 00000100:00100000:1.0:1789583753.503700:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:10307:x1876514313366784:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 370us (929us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789583753.503708:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:0.0:1789583753.508460:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.508555:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313367040 00000100:00100000:3.0:1789583753.508566:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313367040 00000100:00100000:3.0:1789583753.508622:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:3.0:1789583753.508631:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:10307:x1876514313367040:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789583753.508870:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10307:x1876514313367040:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 240us (428us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789583753.508878:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789583753.589539:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.589624:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313367168 00000100:00100000:3.0:1789583753.589634:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313367168 00000100:00100000:3.0:1789583753.589693:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789583753.589703:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10313:x1876514313367168:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583753.589726:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583753.589745:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e317c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec641a expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.589852:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.589867:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.589878:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583753.589996:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789583753.590001:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583753.590020:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.590057:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e317c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec641a expref: 17 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.590076:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec641a expref: 16 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.590084:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583753.590086:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583753.590090:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03800, rc 0) 00000100:00100000:3.0:1789583753.590141:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+16:10313:x1876514313367168:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 439us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583753.590148:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789583753.597232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.597521:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313367424 00000100:00100000:1.0:1789583753.597531:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313367424 00000100:00100000:1.0:1789583753.597589:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:1.0:1789583753.597597:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+16:10313:x1876514313367424:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583753.597616:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583753.597635:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e318a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6421 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.597729:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.597758:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.597769:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583753.597781:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789583753.598538:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e318a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6421 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.598559:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6421 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.598569:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:1.0:1789583753.598571:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583753.598574:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb400, rc 0) 00000100:00100000:1.0:1789583753.598637:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+18:10313:x1876514313367424:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1041us (1416us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789583753.598644:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:0.0:1789583753.605216:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583753.605316:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.607058:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313367808 00000100:00100000:1.0:1789583753.607071:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313367808 00000100:00100000:1.0:1789583753.607130:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:1.0:1789583753.607138:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+18:10313:x1876514313367808:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583753.607161:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583753.607180:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e319f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6428 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.607298:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e31a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.607311:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e31a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.607321:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e31a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583753.607331:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789583753.607458:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e319f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6428 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.607476:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e31a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6428 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.607483:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:1.0:1789583753.607486:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789583753.607489:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa200, rc 0) 00000100:00100000:1.0:1789583753.607757:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+20:10313:x1876514313367808:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 619us (2439us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789583753.607763:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:3.0:1789583753.608793:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313367552 00000100:00100000:3.0:1789583753.609122:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313367552 00000100:00100000:3.0:1789583753.609222:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789583753.609232:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+20:2358:x1876514313367552:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583753.609245:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583753.609266:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6421 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.609294:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:3.0:1789583753.609310:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583753.609353:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:2358:x1876514313367552:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 122us (4146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583753.609360:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:0.0:1789583753.617524:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.618137:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313367936 00000100:00100000:3.0:1789583753.618147:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313367936 00000100:00100000:3.0:1789583753.618252:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:3.0:1789583753.618273:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313367936:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:3.0:1789583753.618327:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.618348:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 7 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.618357:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583753.618361:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583753.618366:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.618403:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 7 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.618416:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 7 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583753.618431:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1876514332273408:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583753.618532:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b4a7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789583753.626528:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583753.627010:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313368064 00000100:00100000:0.0:1789583753.627020:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313368064 00002000:00100000:0.0:1789583753.627067:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88b6752e9180 x1876514313368064/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:469/0 lens 504/0 e 0 to 0 dl 1789583764 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583753.627078:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b6752e9180 with x1876514313368064 ext(0->12) 00010000:00010000:0.0:1789583753.627086:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 8 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.627102:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 8 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583753.627109:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88b6752e9180 00000100:00100000:0.0:1789583753.627136:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583753.627145:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313368064:12345-192.168.203.46@tcp:4:lfs.0 00000100:00100000:3.0:1789583753.627436:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1876514332273408:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583753.627468:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1789583753.683521:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000100:00100000:0.0:1789583753.684494:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2359:x1876514313368064:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 57343us (57968us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789583753.684518:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00002000:00100000:0.0:1789583753.684531:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff88b6752e9180 x1876514313368064/t4294967299(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:469/0 lens 504/448 e 0 to 0 dl 1789583764 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583753.684541:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b6752e9180 with x1876514313368064 ext(0->12) 00010000:00010000:0.0:1789583753.684551:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583753.684569:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583753.684576:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88b6752e9180 00000100:00100000:2.0:1789583753.687755:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.687836:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313368192 00000100:00100000:1.0:1789583753.687846:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313368192 00010000:00010000:1.0:1789583753.687879:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.687924:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:1.0:1789583753.687946:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313368192:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583753.687960:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789583753.687977:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789583753.687980:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789583753 00002000:00010000:1.0:1789583753.687983:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789583753 00002000:00010000:1.0:1789583753.687985:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789583753 00010000:00010000:1.0:1789583753.687991:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688004:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688028:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b036190e/0x6d3e73d72c6e3167 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec640c expref: 9 pid: 9665 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688049:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789583753.688053:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789583753.688059:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688068:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688094:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583753.688661:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313368192:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 714us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583753.688669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00010000:00010000:1.0:1789583753.688702:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688711:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688735:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688744:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688751:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688757:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583753.688761:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688769:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688782:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.688789:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7cea220/0x6d3e73d72c6e31b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.689425:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313367936:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 71162us (71909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583753.689434:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:3.0:1789583753.694331:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.694488:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313368448 00000100:00100000:2.0:1789583753.694499:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313368448 00000100:00100000:2.0:1789583753.694563:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:2.0:1789583753.694574:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+19:10313:x1876514313368448:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:2.0:1789583753.694638:0:5851:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e31a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6428 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583753.695023:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789583753.695245:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789583753.698291:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789583753.698383:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.698403:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.698412:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.698460:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.698474:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 23 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583753.698487:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332273536:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583753.698671:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789583753.708161:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332273536:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583753.708193:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583753.709980:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.710307:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313368576 00000100:00100000:1.0:1789583753.710317:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313368576 00010000:00010000:1.0:1789583753.710354:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 24 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.710396:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:1.0:1789583753.710407:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+24:2358:x1876514313368576:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583753.710421:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583753.710428:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 24 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.710441:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 24 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.710475:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e314b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63fe expref: 24 pid: 5848 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.710494:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:1.0:1789583753.710513:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.710523:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.710531:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.710566:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583753.710626:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+23:2358:x1876514313368576:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 221us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583753.710634:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00010000:00010000:2.0:1789583753.711246:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.711256:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583753.711384:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789583753.711591:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789583753.711891:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752ead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332273664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789583753.711942:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583753.712078:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583753.717397:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332273664 00000100:00100000:0.0:1789583753.717411:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332273664 00000100:00100000:0.0:1789583753.717554:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583753.717564:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332273664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583753.717695:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332273664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 132us (5752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583753.717701:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583753.718194:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752ead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332273664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789583753.718885:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789583753.718962:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752ead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332273792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789583753.719008:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583753.719030:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a600 going to sleep for 11 seconds 00000100:00080000:1.0:1789583753.719553:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583753.719667:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332273792 00000100:00100000:0.0:1789583753.719675:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332273792 00000100:00100000:0.0:1789583753.719722:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583753.719730:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332273792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583753.720597:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1876514332273792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 666us (1386us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789583753.720607:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583753.720750:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752ead80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332273792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789583753.720854:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789583753.720912:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.720923:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.720930:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.720935:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583753.720939:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.720954:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.720970:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:2.0:1789583753.720973:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789583753.720978:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.720984:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789583753.721426:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789583753.722192:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789583753.722206:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310706399716ns, next at 311706397305ns, rc = 0 00000001:00080000:2.0:1789583753.722215:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789583753.722262:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a600) 00010000:00010000:2.0:1789583753.722266:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789583753.722273:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e31a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6428 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583753.722502:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+26:10313:x1876514313368448:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 27928us (28179us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789583753.722510:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000020:00080000:2.0:1789583753.722515:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789583753.728986:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.729098:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313368704 00000100:00100000:2.0:1789583753.729108:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313368704 00000100:00100000:2.0:1789583753.729164:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:2.0:1789583753.729173:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+26:10313:x1876514313368704:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583753.729212:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583753.729234:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec642f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.729301:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec642f expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.729316:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec642f expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583753.729335:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583753.729339:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583753.729342:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0200, rc 0) 00000100:00100000:2.0:1789583753.729403:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10313:x1876514313368704:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 231us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583753.729409:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:0.0:1789583753.734935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.737249:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313368960 00000100:00100000:1.0:1789583753.737263:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313368960 00000100:00100000:0.0:1789583753.738229:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:0.0:1789583753.738239:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10313:x1876514313368960:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789583753.738668:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:10313:x1876514313368960:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 422us (3733us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789583753.738676:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00010000:00010000:0.0:1789583753.767121:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583753.831671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.831772:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313369216 00000100:00100000:3.0:1789583753.831781:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313369216 00000100:00100000:3.0:1789583753.831872:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:3.0:1789583753.831883:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+28:10324:x1876514313369216:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583753.831906:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583753.831926:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e31c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6436 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583753.832012:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789583753.832124:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e31c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6436 expref: 30 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.832138:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583753.832141:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583753.832146:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e31c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6436 expref: 30 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.832160:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03c00, rc 0) 00000100:00100000:3.0:1789583753.832209:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10324:x1876514313369216:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 327us (559us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789583753.832229:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789583753.839785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583753.849475:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313369344 00000100:00100000:1.0:1789583753.849491:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313369344 00000100:00100000:1.0:1789583753.849621:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:1.0:1789583753.849632:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10324:x1876514313369344:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789583753.849705:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849723:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849746:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849761:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849785:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849793:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849898:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849907:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849915:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583753.849958:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849970:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849976:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849982:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849988:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583753.849992:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.849999:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850018:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583753.850020:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583753.850026:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850032:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e31d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850046:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850053:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850058:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850063:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583753.850066:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850073:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850080:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b645246400) 00010000:00010000:1.0:1789583753.850083:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583753.850085:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850090:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e31de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850113:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850119:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850125:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850130:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583753.850133:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850138:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850145:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583753.850147:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583753.850150:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583753.850156:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e31e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583753.850239:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10324:x1876514313369344:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 608us (10462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583753.850247:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:0.0:1789583753.858990:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.859240:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313369600 00000100:00100000:2.0:1789583753.859251:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313369600 00000100:00100000:2.0:1789583753.859316:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789583753.859326:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10324:x1876514313369600:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583753.859580:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+30:10324:x1876514313369600:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 255us (598us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789583753.859589:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583753.906668:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.906759:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313369856 00000100:00100000:3.0:1789583753.906779:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313369856 00000100:00100000:3.0:1789583753.906863:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:3.0:1789583753.906874:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+30:10327:x1876514313369856:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583753.906897:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583753.906916:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e31ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec643d expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.906992:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907008:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907020:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907034:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907041:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907047:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907173:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907198:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907206:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583753.907216:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789583753.907307:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907314:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907320:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907325:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.907329:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907336:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907347:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583753.907350:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.907355:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907361:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e31f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907374:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907385:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907390:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907396:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.907399:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907405:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907414:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b64336a700) 00010000:00010000:3.0:1789583753.907416:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583753.907419:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907425:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e31fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907480:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e31ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 33 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907495:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 32 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.907502:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583753.907505:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583753.907513:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03400, rc 0) 00000100:00100000:3.0:1789583753.907576:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10327:x1876514313369856:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 704us (917us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789583753.907583:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:0.0:1789583753.915626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583753.915714:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313369984 00000100:00100000:3.0:1789583753.915724:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313369984 00000100:00100000:3.0:1789583753.915788:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789583753.915798:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10327:x1876514313369984:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789583753.915891:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915909:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915923:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915946:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915953:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915961:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915967:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583753.915971:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.915978:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.916005:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583753.916008:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583753.916013:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583753.916020:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e320f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583753.916084:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10327:x1876514313369984:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583753.916092:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:0.0:1789583753.932410:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583753.932704:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313370240 00000100:00100000:2.0:1789583753.932715:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313370240 00000100:00100000:2.0:1789583753.932780:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789583753.932851:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10327:x1876514313370240:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583753.933109:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+33:10327:x1876514313370240:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 293us (693us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789583753.933117:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789583754.191471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583754.192191:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313370496 00000100:00100000:3.0:1789583754.192203:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313370496 00000100:00100000:3.0:1789583754.192268:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:3.0:1789583754.192278:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+33:10358:x1876514313370496:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:3.0:1789583754.192304:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583754.192325:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6444 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.192422:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e321d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.192446:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e321d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.192460:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e321d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583754.192471:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789583754.192624:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6444 expref: 36 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.192643:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e321d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6444 expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.192652:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583754.192654:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583754.192658:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02a00, rc 0) 00000100:00100000:3.0:1789583754.192721:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10358:x1876514313370496:12345-192.168.203.46@tcp:101:cat.0 Request processed in 445us (1258us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789583754.192728:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583754.201259:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583754.201353:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583754.201897:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313370624 00000100:00100000:3.0:1789583754.201907:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313370624 00000100:00100000:3.0:1789583754.201976:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:3.0:1789583754.201987:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+35:2359:x1876514313370624:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583754.202003:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583754.202030:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e321d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6444 expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.202276:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583754.202280:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583754.202341:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+34:2359:x1876514313370624:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 355us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583754.202348:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:1.0:1789583754.206692:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313370880 00000100:00100000:1.0:1789583754.206708:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313370880 00000100:00100000:1.0:1789583754.206976:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:1.0:1789583754.207002:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+34:10358:x1876514313370880:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:1.0:1789583754.207254:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10358:x1876514313370880:12345-192.168.203.46@tcp:35:cat.0 Request processed in 253us (5900us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789583754.207261:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789583754.274494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583754.274615:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313371136 00000100:00100000:3.0:1789583754.274630:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313371136 00000100:00100000:3.0:1789583754.274738:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:3.0:1789583754.274759:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10364:x1876514313371136:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:3.0:1789583754.274801:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583754.274847:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789583754.274895:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec641a expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.274925:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583754.274934:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583754.274952:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e322b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec644b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.275147:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.275168:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.275179:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.275230:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.275249:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 35 pid: 8280 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583754.275267:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332273920:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583754.275405:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b649068900 going to sleep for 11 seconds 00000100:00100000:3.0:1789583754.277582:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332273920:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583754.277621:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583754.280569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583754.280656:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313371264 00000100:00100000:1.0:1789583754.280668:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313371264 00010000:00010000:1.0:1789583754.280731:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 36 pid: 8280 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583754.280784:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789583754.280796:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+36:2358:x1876514313371264:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583754.280857:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583754.280867:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 36 pid: 8280 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.280882:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 36 pid: 8280 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.280909:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e3201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec643d expref: 36 pid: 8280 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.280928:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583754.280934:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.280944:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.280973:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.281009:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583754.281072:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:2358:x1876514313371264:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 278us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583754.281080:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00010000:00010000:3.0:1789583754.281125:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.281143:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583754.281168:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789583754.281379:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e322b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.281415:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 35 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.281425:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583754.281428:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789583754.281432:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03c00, rc 0) 00000100:00100000:3.0:1789583754.281515:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10364:x1876514313371136:12345-192.168.203.46@tcp:101:dd.0 Request processed in 6766us (7040us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789583754.281525:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:0.0:1789583754.286140:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583754.286208:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313371520 00000100:00100000:3.0:1789583754.286225:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313371520 00000100:00100000:3.0:1789583754.286306:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:3.0:1789583754.286319:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10364:x1876514313371520:12345-192.168.203.46@tcp:36:dd.0 00010000:00010000:3.0:1789583754.286699:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.286721:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.286735:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583754.286793:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789583754.286867:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000727fa88a reply state 0000000078a16f48 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583754.286878:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583754.287007:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+38:10364:x1876514313371520:12345-192.168.203.46@tcp:36:dd.0 Request processed in 691us (877us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789583754.287016:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000020:00080000:3.0:1789583754.287022:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789583754.288870:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.288891:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.288899:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.288906:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583754.288913:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.288921:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.288958:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583754.288962:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583754.288969:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.288977:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3240 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583754.619072:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583754.620154:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313371648 00000100:00100000:1.0:1789583754.620173:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313371648 00000100:00100000:1.0:1789583754.620315:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:1.0:1789583754.620327:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+37:10378:x1876514313371648:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:1.0:1789583754.620361:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583754.620389:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6452 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.620485:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.620503:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.620516:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.620533:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.620542:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.620571:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.622200:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.622229:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.622239:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.622293:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.622312:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 38 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583754.622330:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332274048:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583754.622543:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789583754.626359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583754.626548:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313371904 00000100:00100000:2.0:1789583754.626559:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313371904 00000100:00100000:2.0:1789583754.626630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789583754.626650:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+39:5596:x1876514313371904:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789583754.627207:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+40:5596:x1876514313371904:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 556us (861us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789583754.627216:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:1.0:1789583754.627924:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332274048:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583754.627958:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583754.628959:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583754.629100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313372032 00000100:00100000:2.0:1789583754.629109:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313372032 00010000:00010000:2.0:1789583754.629153:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 40 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583754.629229:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:2.0:1789583754.629241:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+40:2358:x1876514313372032:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583754.629257:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583754.629265:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 40 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583754.629279:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 40 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583754.629304:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3232 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec644b expref: 40 pid: 5849 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583754.629342:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583754.629348:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583754.629359:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583754.629368:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583754.629401:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583754.629468:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+39:2358:x1876514313372032:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 229us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583754.629477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00010000:00010000:1.0:1789583754.629782:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629791:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583754.629882:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789583754.629888:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583754.629932:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629946:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629958:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629965:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629972:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629978:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583754.629983:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.629992:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630002:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583754.630004:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583754.630009:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630015:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e324e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630051:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630058:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630064:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630070:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583754.630073:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630079:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630087:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b645246400) 00010000:00010000:1.0:1789583754.630089:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583754.630092:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630098:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630142:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6452 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630157:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6452 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.630176:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583754.630179:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583754.630182:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfbe00, rc 0) 00000100:00100000:1.0:1789583754.630235:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+38:10378:x1876514313371648:12345-192.168.203.46@tcp:101:stat.0 Request processed in 9910us (11178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583754.630243:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:0.0:1789583754.724933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583754.725090:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313372288 00000100:00100000:3.0:1789583754.725104:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313372288 00000100:00100000:3.0:1789583754.725237:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789583754.725250:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+38:10383:x1876514313372288:12345-192.168.203.46@tcp:36:truncate.0 00010000:00010000:3.0:1789583754.725325:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583754.725374:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e325c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6452 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.725398:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583754.725404:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583754.725690:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.725708:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.725720:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583754.725781:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789583754.725876:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000230a54b4 reply state 0000000029722efb transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583754.725905:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583754.727122:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+40:10383:x1876514313372288:12345-192.168.203.46@tcp:36:truncate.0 Request processed in 1865us (2193us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789583754.727135:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000020:00080000:3.0:1789583754.727143:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789583754.732458:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.732482:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.732491:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.732499:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583754.732504:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.732513:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.732535:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583754.732538:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583754.732545:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.732552:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3263 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583754.791335:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332274176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583754.791456:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583754.791468:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332274432:0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.791517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583754.791546:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332274944:0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.791549:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332274688:0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.791582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583754.791608:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583754.791616:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332274560:0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.791638:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583754.791691:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274432 00000100:00100000:3.0:1789583754.791699:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274432 00000100:00100000:3.0:1789583754.791753:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274560 00000100:00100000:3.0:1789583754.791756:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274560 00000100:00100000:3.0:1789583754.791794:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789583754.791823:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332274432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.791892:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332274432:12345-0@lo:400:kworker.0 Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583754.791899:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789583754.791921:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789583754.791927:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332274560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.791954:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332274560:12345-0@lo:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583754.791960:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789583754.792005:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332274560:0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.792019:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332274432:0@lo:400:kworker.0 00000100:00100000:2.0:1789583754.792049:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332274304:0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.792100:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583754.792145:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789583754.792168:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583754.792209:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274944 00000100:00100000:0.0:1789583754.792215:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274944 00000100:00100000:2.0:1789583754.792221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332274816:0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.792248:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274688 00000100:00100000:0.0:1789583754.792253:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274688 00000100:00100000:0.0:1789583754.792278:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583754.792285:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332274944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.792348:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332274944:12345-0@lo:400:kworker.0 Request processed in 44us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583754.792356:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583754.792375:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789583754.792383:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332274688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.792427:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332274688:12345-0@lo:400:kworker.0 Request processed in 44us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583754.792449:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789583754.792467:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789583754.792937:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583754.792992:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332274688:0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.793044:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274304 00000100:00100000:0.0:1789583754.793049:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274304 00000100:00100000:0.0:1789583754.793093:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789583754.793102:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274176 00000100:00100000:0.0:1789583754.793103:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332274304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583754.793109:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274176 00000100:00100000:1.0:1789583754.793151:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789583754.793166:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332274176:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583754.793166:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332274304:12345-0@lo:400:kworker.0 Request processed in 60us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583754.793180:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00002000:00000024:1.0:1789583754.793278:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583754.793300:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675088e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332274944:0@lo:400:kworker.0 00000100:00100000:1.0:1789583754.793338:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332274176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583754.793351:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789583754.793449:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332274176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583754.800694:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583754.800800:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332274304:0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.801052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332274816 00000100:00100000:3.0:1789583754.801061:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332274816 00000100:00100000:3.0:1789583754.801142:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789583754.801152:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332274816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583754.801240:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332274816:12345-0@lo:400:kworker.0 Request processed in 80us (8797us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583754.801248:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1789583754.801411:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583754.801477:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c4a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332274816:0@lo:400:kworker.0 00000100:00100000:0.0:1789583754.874139:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583754.874749:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313372416 00000100:00100000:1.0:1789583754.874761:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313372416 00000100:00100000:1.0:1789583754.874845:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:1.0:1789583754.874856:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+39:10398:x1876514313372416:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:1.0:1789583754.874880:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583754.874899:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e326a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6459 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.874974:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875000:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875012:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875026:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875034:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875040:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875123:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875131:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875137:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583754.875172:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789583754.875176:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583754.875195:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875207:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875226:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875232:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875239:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875246:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583754.875251:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875258:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875270:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583754.875273:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583754.875278:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875285:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3271 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875298:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875305:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875311:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875322:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583754.875324:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875330:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875338:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b645246400) 00010000:00010000:1.0:1789583754.875340:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583754.875343:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875363:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3278 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875397:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e326a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875410:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583754.875417:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583754.875419:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583754.875422:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583754.875502:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+40:10398:x1876514313372416:12345-192.168.203.46@tcp:101:stat.0 Request processed in 649us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583754.875509:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:0.0:1789583754.952095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583754.952365:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313372672 00000100:00100000:3.0:1789583754.952375:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313372672 00000100:00100000:3.0:1789583754.952451:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:3.0:1789583754.952461:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+40:10408:x1876514313372672:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583754.952481:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583754.952502:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6460 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583754.952600:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789583754.952721:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3286 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6460 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.952734:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583754.952736:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583754.952741:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6460 expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583754.952755:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03800, rc 0) 00000100:00100000:3.0:1789583754.952859:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+41:10408:x1876514313372672:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 398us (772us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789583754.952867:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:2.0:1789583754.961352:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583754.961518:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313372928 00000100:00100000:1.0:1789583754.961551:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313372928 00000100:00100000:1.0:1789583754.961609:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:1.0:1789583754.961620:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+41:10408:x1876514313372928:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583754.961892:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+42:10408:x1876514313372928:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 273us (548us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789583754.961900:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:2.0:1789583755.024657:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583755.024731:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313373184 00000100:00100000:1.0:1789583755.024739:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313373184 00000100:00100000:1.0:1789583755.024803:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:1.0:1789583755.024844:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+42:10414:x1876514313373184:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789583755.024869:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583755.024892:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3294 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6467 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.025008:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.025023:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.025032:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.025066:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.025080:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 43 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583755.025109:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332275072:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583755.025198:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b3c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789583755.025791:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583755.034302:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332275072:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583755.034332:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583755.036846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.036951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313373312 00000100:00100000:3.0:1789583755.036976:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313373312 00010000:00010000:3.0:1789583755.037020:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 44 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583755.037065:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:3.0:1789583755.037074:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+44:2359:x1876514313373312:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583755.037088:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583755.037094:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 44 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.037107:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 44 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.037138:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e327f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6459 expref: 44 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.037157:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583755.037162:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.037171:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.037260:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.037458:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583755.037519:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+43:2359:x1876514313373312:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 445us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.037537:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00010000:00010000:2.0:1789583755.040326:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.040487:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583755.040509:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789583755.040675:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3294 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 44 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.040695:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.040704:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583755.040706:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789583755.040710:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfbc00, rc 0) 00000100:00100000:2.0:1789583755.041149:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+43:10414:x1876514313373184:12345-192.168.203.46@tcp:101:bash.0 Request processed in 16304us (16497us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789583755.041158:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:2.0:1789583755.048087:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.048301:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313373568 00000100:00100000:3.0:1789583755.048311:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313373568 00000100:00100000:3.0:1789583755.048378:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:3.0:1789583755.048389:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+43:10414:x1876514313373568:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:3.0:1789583755.048659:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.048676:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.048687:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583755.048737:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789583755.048761:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c5d2896 reply state 000000000516a6b5 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583755.048770:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583755.048889:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+46:10414:x1876514313373568:12345-192.168.203.46@tcp:36:bash.0 Request processed in 502us (810us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789583755.048897:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000020:00080000:3.0:1789583755.048902:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789583755.055106:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.055124:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.055247:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.055268:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583755.055273:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.055281:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.055297:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583755.055299:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583755.055304:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.055311:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583755.056985:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.057644:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313373696 00000100:00100000:3.0:1789583755.057654:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313373696 00000100:00100000:3.0:1789583755.057758:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789583755.057768:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+45:10414:x1876514313373696:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789583755.057791:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583755.057849:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e32b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec646e expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.057940:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.057955:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.057980:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.058016:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.058639:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 46 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583755.058659:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675088e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332275200:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583755.058752:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c80e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583755.063328:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675088e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332275200:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583755.063365:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583755.063471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.063537:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313373824 00000100:00100000:3.0:1789583755.063544:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313373824 00010000:00010000:3.0:1789583755.063575:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 47 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583755.063612:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:3.0:1789583755.063621:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+47:2359:x1876514313373824:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583755.063635:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583755.063641:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 47 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.063668:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 47 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.063688:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e329b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6467 expref: 47 pid: 5850 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.063702:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583755.063707:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.063717:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.063725:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.063760:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583755.063840:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+46:2359:x1876514313373824:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 220us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.063848:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00010000:00010000:0.0:1789583755.064848:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583755.064857:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583755.065106:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789583755.065112:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583755.065142:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583755.065176:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e32b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec646e expref: 46 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583755.065194:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec646e expref: 45 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583755.065202:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583755.065205:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583755.065208:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03e00, rc 0) 00000100:00100000:0.0:1789583755.065648:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+45:10414:x1876514313373696:12345-192.168.203.46@tcp:101:bash.0 Request processed in 7877us (8668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583755.065656:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:0.0:1789583755.068757:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.069020:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313374080 00000100:00100000:2.0:1789583755.069031:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313374080 00000100:00100000:2.0:1789583755.069368:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:2.0:1789583755.069379:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+45:10414:x1876514313374080:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789583755.069634:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511ef450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+46:10414:x1876514313374080:12345-192.168.203.46@tcp:35:bash.0 Request processed in 255us (893us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789583755.069641:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:2.0:1789583755.152394:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.152499:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313374336 00000100:00100000:3.0:1789583755.152509:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313374336 00000100:00100000:3.0:1789583755.152612:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:3.0:1789583755.152623:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+46:10424:x1876514313374336:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583755.152646:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583755.152667:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6475 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583755.152774:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789583755.152917:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6475 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.152940:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583755.152943:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583755.152949:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e32be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6475 expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.152963:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03800, rc 0) 00000100:00100000:3.0:1789583755.153012:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10424:x1876514313374336:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 391us (628us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789583755.153018:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:3.0:1789583755.158676:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.161095:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313374464 00000100:00100000:2.0:1789583755.161109:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313374464 00000100:00100000:2.0:1789583755.161217:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:2.0:1789583755.161227:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10424:x1876514313374464:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789583755.161294:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161322:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161334:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161349:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161355:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161361:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161469:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161477:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161483:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583755.161522:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161547:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161553:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161560:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161566:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583755.161569:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161576:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161588:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583755.161591:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583755.161596:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161602:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e32cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161615:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161620:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161625:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161636:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583755.161639:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161645:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161653:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4c00) 00010000:00010000:2.0:1789583755.161655:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583755.161657:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161663:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e32d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161679:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161685:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161690:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161694:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583755.161697:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161702:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161719:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583755.161722:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583755.161725:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.161731:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e32da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583755.161838:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10424:x1876514313374464:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 612us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583755.161846:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:0.0:1789583755.164705:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.165015:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313374720 00000100:00100000:2.0:1789583755.165034:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313374720 00000100:00100000:2.0:1789583755.165090:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789583755.165101:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10424:x1876514313374720:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583755.165498:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+48:10424:x1876514313374720:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 398us (800us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789583755.165507:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583755.214688:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583755.214894:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313374976 00000100:00100000:1.0:1789583755.214909:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313374976 00000100:00100000:1.0:1789583755.214967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:1.0:1789583755.214978:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+48:10427:x1876514313374976:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583755.215004:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583755.215024:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e32e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec647c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215095:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215109:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215120:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215135:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215143:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215163:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215886:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e32f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215900:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e32f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.215909:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e32f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583755.215920:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789583755.216020:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216028:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216035:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216041:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583755.216045:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216054:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216065:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583755.216067:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583755.216080:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216087:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e32e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216101:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216107:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216113:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216118:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583755.216120:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216125:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216133:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b645246400) 00010000:00010000:1.0:1789583755.216135:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583755.216137:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216142:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e32ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216186:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e32e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec647c expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216211:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e32f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec647c expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.216218:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583755.216220:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583755.216222:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb600, rc 0) 00000100:00100000:1.0:1789583755.217075:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10427:x1876514313374976:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2094us (2392us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789583755.217084:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:3.0:1789583755.220770:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583755.220874:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313375104 00000100:00100000:1.0:1789583755.220884:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313375104 00000100:00100000:1.0:1789583755.221232:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789583755.221241:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+50:2358:x1876514313375104:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583755.221255:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583755.221277:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e32f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec647c expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583755.221296:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583755.221301:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583755.221359:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+49:2358:x1876514313375104:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 119us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583755.221367:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:2.0:1789583755.221528:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.221780:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313375232 00000100:00100000:3.0:1789583755.221786:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313375232 00000100:00100000:3.0:1789583755.221854:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:3.0:1789583755.221863:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10427:x1876514313375232:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789583755.222342:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222359:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222369:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222405:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222412:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222419:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222425:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583755.222429:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222445:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222454:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583755.222457:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583755.222461:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.222468:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3304 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583755.222520:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10427:x1876514313375232:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 658us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.222527:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:0.0:1789583755.224420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.224522:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313375488 00000100:00100000:2.0:1789583755.224530:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313375488 00000100:00100000:2.0:1789583755.224612:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789583755.224622:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10427:x1876514313375488:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583755.224857:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10427:x1876514313375488:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 236us (444us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789583755.224865:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789583755.304408:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:2.0:1789583755.304472:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312288665235ns, next at 313288663182ns, rc = 0 00000100:00100000:0.0:1789583755.306447:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332275328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583755.306537:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583755.310198:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332275328 00000100:00100000:2.0:1789583755.310213:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332275328 00000100:00100000:2.0:1789583755.310390:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789583755.310403:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332275328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583755.310453:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583755.310543:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332275328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583755.310550:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789583755.310640:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332275328:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789583755.311597:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583755.344732:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.344832:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313375744 00000100:00100000:3.0:1789583755.344854:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313375744 00000100:00100000:3.0:1789583755.344917:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:3.0:1789583755.344927:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10445:x1876514313375744:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:3.0:1789583755.344963:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583755.344983:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e330b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6483 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.345098:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3312 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.345113:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.345123:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3312 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583755.345134:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789583755.345250:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e330b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6483 expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.345269:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3312 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6483 expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.345277:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583755.345280:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789583755.345284:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03600, rc 0) 00000100:00100000:3.0:1789583755.345343:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10445:x1876514313375744:12345-192.168.203.46@tcp:101:cat.0 Request processed in 418us (620us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789583755.345350:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:3.0:1789583755.371242:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.371390:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313375872 00000100:00100000:2.0:1789583755.371402:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313375872 00000100:00100000:2.0:1789583755.371470:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:2.0:1789583755.371480:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10446:x1876514313375872:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583755.371504:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583755.371525:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec648a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.371590:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3327 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.371604:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.371616:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583755.371714:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789583755.371718:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583755.371739:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3327 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.371780:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec648a expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.371799:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3327 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec648a expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.371914:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583755.371918:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583755.371921:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1400, rc 0) 00000100:00100000:2.0:1789583755.371987:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10446:x1876514313375872:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 508us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583755.371995:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:0.0:1789583755.378595:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.378671:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313376256 00000100:00100000:2.0:1789583755.378681:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313376256 00000100:00100000:2.0:1789583755.378741:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:2.0:1789583755.378751:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10446:x1876514313376256:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583755.379087:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10446:x1876514313376256:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 337us (501us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789583755.379094:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:0.0:1789583755.381240:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.383604:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313376384 00000100:00100000:3.0:1789583755.383619:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313376384 00000100:00100000:3.0:1789583755.383701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789583755.383710:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10446:x1876514313376384:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:3.0:1789583755.383724:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789583755.383748:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e32b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec646e expref: 54 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.383768:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3312 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6483 expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.383779:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e31c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec642f expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.383789:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583755.383800:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583755.383892:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+51:10446:x1876514313376384:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 183us (2660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.383901:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583755.391950:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.392038:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313376512 00000100:00100000:3.0:1789583755.392048:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313376512 00000100:00100000:3.0:1789583755.392109:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:3.0:1789583755.392119:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+51:10446:x1876514313376512:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:3.0:1789583755.392213:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.392228:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583755.392252:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789583755.392526:0:5849:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583755.392741:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789583755.392801:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789583755.392926:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+51:10446:x1876514313376512:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 808us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.392934:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:0.0:1789583755.413519:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.415072:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313376640 00000100:00100000:2.0:1789583755.415085:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313376640 00000100:00100000:2.0:1789583755.415213:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:2.0:1789583755.415224:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+51:10448:x1876514313376640:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583755.415245:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583755.415264:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3335 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6491 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415353:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415367:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415380:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415394:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415401:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415406:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415502:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415511:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415518:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583755.415551:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789583755.415555:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583755.415571:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415594:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415603:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415610:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415618:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415624:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583755.415628:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415636:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415785:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583755.415790:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583755.415796:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415825:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e333c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415841:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415849:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415862:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415867:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583755.415870:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415877:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415886:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4c00) 00010000:00010000:2.0:1789583755.415889:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583755.415892:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415898:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415931:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3335 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415946:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583755.415954:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:2.0:1789583755.415957:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583755.415959:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0a00, rc 0) 00000100:00100000:2.0:1789583755.416035:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10448:x1876514313376640:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 813us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583755.416050:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00010000:00010000:1.0:1789583755.815611:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583755.833750:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583755.833790:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.833863:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313376896 00000100:00100000:0.0:1789583755.833863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583755.833880:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313376896 00000100:00100000:0.0:1789583755.833898:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313376768 00000100:00100000:0.0:1789583755.833909:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313376768 00000100:00100000:3.0:1789583755.833969:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377152 00000100:00100000:3.0:1789583755.833975:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377152 00000100:00100000:0.0:1789583755.833992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 283 00000100:00100000:0.0:1789583755.834006:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313376768:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583755.834049:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789583755.834061:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:2358:x1876514313376896:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583755.834160:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:2358:x1876514313376896:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 101us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.834168:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789583755.834195:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:3.0:1789583755.834204:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313377152:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583755.834238:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313377152:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 36us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583755.834245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00080000:3.0:1789583755.834273:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583755.834546:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313376768:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 540us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583755.834556:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 283 00000100:00100000:0.0:1789583755.851635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583755.853360:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377024 00000100:00100000:2.0:1789583755.853378:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377024 00000100:00080000:3.0:1789583755.853460:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583755.853490:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:2.0:1789583755.853504:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313377024:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583755.853593:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313377024:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 92us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583755.853601:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000040:00080000:0.0:1789583756.202445:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789583756.202456:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789583756.202511:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789583756.202519:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789583756.202686:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6488b7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332275456:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789583756.202832:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b649eb1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583756.213722:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6488b7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332275456:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789583756.217578:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.220731:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377280 00000100:00100000:1.0:1789583756.220751:0:5860:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377280 00000100:00100000:1.0:1789583756.220853:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:1.0:1789583756.220867:0:5860:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377280:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789583756.220984:0:5860:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377280:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 Request processed in 119us (3419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.220993:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789583756.225421:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583756.227206:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377408 00000100:00100000:2.0:1789583756.227223:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377408 00000100:00100000:2.0:1789583756.227296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:2.0:1789583756.227307:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377408:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789583756.227347:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789583756.227499:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377408:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 192us (2090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583756.227507:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:2.0:1789583756.234117:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.234465:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377536 00000100:00100000:3.0:1789583756.234486:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377536 00000100:00100000:3.0:1789583756.234570:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:3.0:1789583756.234593:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377536:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789583756.234696:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234717:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234733:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234752:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234761:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234768:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234800:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234832:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234840:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583756.234888:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789583756.234894:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583756.234917:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234930:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234938:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234946:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234953:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.234958:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234966:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.234982:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:3.0:1789583756.234985:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583756.234992:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235000:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e3351 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235015:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235022:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235028:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235042:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.235045:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235052:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235061:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff88b64336aa00) 00010000:00010000:3.0:1789583756.235064:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583756.235067:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235073:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3358 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235091:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235098:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235104:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235108:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.235110:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235116:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235134:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583756.235136:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583756.235140:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.235146:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e335f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.235242:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377536:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 660us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583756.235251:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583756.243910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.244036:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377792 00000100:00100000:3.0:1789583756.244049:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377792 00000100:00100000:3.0:1789583756.244119:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:3.0:1789583756.244130:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10459:x1876514313377792:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583756.244158:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583756.244186:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3366 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6498 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244313:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244330:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244345:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583756.244359:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789583756.244508:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244518:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244526:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244533:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.244538:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244547:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244561:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583756.244564:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583756.244570:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244577:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e336d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244631:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3366 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6498 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244642:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:3.0:1789583756.244645:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583756.244649:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3366 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6498 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.244672:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03c00, rc 0) 00000100:00100000:3.0:1789583756.244748:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10459:x1876514313377792:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 619us (851us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789583756.244755:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:3.0:1789583756.255134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583756.255234:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313377920 00000100:00100000:0.0:1789583756.255254:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313377920 00000100:00100000:0.0:1789583756.255319:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:0.0:1789583756.255330:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10459:x1876514313377920:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789583756.255373:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789583756.255518:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675088000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10459:x1876514313377920:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 189us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583756.255527:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:1.0:1789583756.269359:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.269404:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313378176 00000100:00100000:1.0:1789583756.269416:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313378176 00000100:00100000:1.0:1789583756.269797:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:1.0:1789583756.269841:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10459:x1876514313378176:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583756.269870:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583756.269874:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789583756.269909:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec648a expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.269929:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583756.269936:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583756.269953:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e337b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec649f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789583756.270610:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00000040:00080000:3.0:1789583756.270734:0:12017:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789583756.270741:0:12017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789583756.270800:0:12017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789583756.270834:0:12017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789583756.270995:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3382 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.271019:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.271042:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3382 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.271119:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e337b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec649f expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.271140:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3382 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec649f expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.271149:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583756.271153:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583756.271157:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfaa00, rc 0) 00000100:00100000:1.0:1789583756.271242:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10459:x1876514313378176:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1434us (1896us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789583756.271252:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:2.0:1789583756.279071:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.279165:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313378432 00000100:00100000:3.0:1789583756.279177:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313378432 00000100:00100000:3.0:1789583756.279251:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:3.0:1789583756.279264:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10459:x1876514313378432:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789583756.279342:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583756.279460:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3382 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec649f expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.279485:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583756.279499:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583756.279528:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.279608:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.279624:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282007:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282038:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282053:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282160:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282170:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282178:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282185:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583756.282190:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282199:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282214:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583756.282217:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583756.282223:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282230:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3390 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282248:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282255:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282261:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282273:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583756.282276:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282282:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282290:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb39098bf (ffff88b6583d4c00) 00010000:00010000:2.0:1789583756.282293:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583756.282296:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.282302:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3397 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb39098bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.282464:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10459:x1876514313378432:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 3196us (3400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789583756.282474:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:2.0:1789583756.287586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583756.287708:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313378560 00000100:00100000:0.0:1789583756.287722:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313378560 00000100:00100000:0.0:1789583756.288020:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:0.0:1789583756.288033:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10459:x1876514313378560:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789583756.288060:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583756.288088:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e339e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64a6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.288134:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.288151:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.288163:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.288282:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e339e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.288300:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 54 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.288319:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:0.0:1789583756.288322:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789583756.288327:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca200, rc 0) 00000100:00100000:0.0:1789583756.288417:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10459:x1876514313378560:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 386us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583756.288434:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:0.0:1789583756.292235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583756.292398:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313378816 00000100:00100000:2.0:1789583756.292410:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313378816 00000100:00100000:2.0:1789583756.292518:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:2.0:1789583756.292530:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10459:x1876514313378816:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789583756.292642:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.292664:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.292788:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583756.293238:0:8280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789583756.293251:0:8280:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313277444176ns, next at 314277440924ns, rc = 0 00000004:00010000:2.0:1789583756.293634:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000808e5560 reply state 00000000feffa0fd transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.293647:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583756.293792:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10459:x1876514313378816:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 1261us (1567us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789583756.293802:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 75 00010000:00010000:1.0:1789583756.296636:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.296653:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.296662:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.296670:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583756.296676:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.296685:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.296716:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:1.0:1789583756.296719:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789583756.296726:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.296794:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e33ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.299368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.301537:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313378944 00000100:00100000:1.0:1789583756.301559:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313378944 00000100:00100000:1.0:1789583756.301645:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:1.0:1789583756.301658:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10459:x1876514313378944:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583756.301689:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583756.301715:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.301999:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.302027:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.302053:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:1.0:1789583756.302057:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583756.302062:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583756.302157:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10459:x1876514313378944:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 502us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.302178:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:3.0:1789583756.305953:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.306353:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313379072 00000100:00100000:1.0:1789583756.306366:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313379072 00000100:00100000:1.0:1789583756.306441:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789583756.306451:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1876514313379072:12345-192.168.203.46@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789583756.306494:0:9665:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1789583756.306534:0:9665:0:(genops.c:1384:class_connect()) connect: client 768b736a-7b4a-4614-9d07-b155a4183a8a, cookie 0x6d3e73d72c6e33ba 00002000:00100000:1.0:1789583756.306550:0:9665:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 768b736a-7b4a-4614-9d07-b155a4183a8a/ffff88b6751f6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789583756.306582:0:9665:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789583756.306915:0:9665:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789583756.306956:0:9665:0:(import.c:65:import_set_state_nolock()) ffff88b6751f0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789583756.307159:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2357:x1876514313379072:12345-192.168.203.46@tcp:8:lhsmtool_posix.0 Request processed in 706us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.307169:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:2.0:1789583756.321653:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.321742:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313379200 00000100:00100000:3.0:1789583756.321757:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313379200 00000100:00080000:0.0:1789583756.321868:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583756.322151:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:2.0:1789583756.322165:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:0:x1876514313379200:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000001:00100000:3.0:1789583756.421840:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000001:00080000:3.0:1789583756.421867:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789583756.422040:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:0:x1876514313379200:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 99870us (100393us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789583756.422054:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:3.0:1789583756.430151:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583756.430234:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313379456 00000100:00100000:0.0:1789583756.430248:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313379456 00000100:00100000:0.0:1789583756.430349:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:0.0:1789583756.430362:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10459:x1876514313379456:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789583756.432302:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10459:x1876514313379456:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1931us (2149us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789583756.432317:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:3.0:1789583756.436119:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583756.443157:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313379712 00000100:00100000:0.0:1789583756.443178:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313379712 00000100:00100000:0.0:1789583756.443494:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:0.0:1789583756.443505:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10459:x1876514313379712:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789583756.443741:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10459:x1876514313379712:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 236us (7635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583756.443761:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:3.0:1789583756.448610:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583756.448737:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313379840 00000100:00100000:0.0:1789583756.448751:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313379840 00000100:00100000:0.0:1789583756.448846:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:0.0:1789583756.448860:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10459:x1876514313379840:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789583756.448888:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583756.448916:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e33c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.449007:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e33c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.449025:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e33c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.449039:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e33c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583756.449087:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583756.449110:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e33c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.449141:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e33c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64b4 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.449161:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e33c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64b4 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.449169:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:0.0:1789583756.449181:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789583756.449186:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cbc00, rc 0) 00000100:00100000:0.0:1789583756.451044:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675088a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+58:10459:x1876514313379840:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 2173us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583756.451060:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:1.0:1789583756.474230:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.474662:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313379968 00000100:00100000:1.0:1789583756.474677:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313379968 00000100:00100000:1.0:1789583756.474755:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:1.0:1789583756.474973:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313379968:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583756.475000:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583756.475129:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64bb expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583756.475164:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaae18b, blocks: 0x1 00010000:00010000:1.0:1789583756.475188:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1789583756.475201:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583756.475211:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.475237:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.475252:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa200, rc 0) 00000100:00100000:1.0:1789583756.475446:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313379968:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 477us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.476108:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:2.0:1789583756.482361:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.482485:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313380224 00000100:00100000:1.0:1789583756.482499:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313380224 00000100:00100000:1.0:1789583756.482580:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:1.0:1789583756.482660:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+58:10459:x1876514313380224:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789583756.483017:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+58:10459:x1876514313380224:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 360us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583756.492138:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.492193:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313380352 00000100:00100000:3.0:1789583756.492206:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313380352 00000100:00100000:3.0:1789583756.492272:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:3.0:1789583756.493405:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:10459:x1876514313380352:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583756.493446:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583756.493474:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64c2 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.493519:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.493530:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583756.493536:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583756.493542:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.493600:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.493618:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.493636:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332275584:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583756.493760:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94240 going to sleep for 11 seconds 00000100:00100000:1.0:1789583756.496775:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:3.0:1789583756.499016:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332275584:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583756.499063:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.499090:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02a00, rc 0) 00000100:00100000:3.0:1789583756.499169:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:10459:x1876514313380352:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 6886us (7041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583756.499180:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:3.0:1789583756.501529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.501577:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313380480 00000100:00100000:3.0:1789583756.501589:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313380480 00010000:00010000:3.0:1789583756.501639:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.501685:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789583756.501695:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6622a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313380480:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583756.501726:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583756.501754:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.502463:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.502495:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd950608/0x6d3e73d72c6e33cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64bb expref: 7 pid: 6702 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.502513:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583756.502517:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583756.502526:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.502537:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.502588:0:8527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.502607:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8527:1876514332275712:192.168.203.46@tcp:105: 00000100:00100000:3.0:1789583756.502719:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94240 going to sleep for 11 seconds 00000100:00100000:1.0:1789583756.511625:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8527:1876514332275712:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789583756.511662:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583756.511752:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6622a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313380480:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 10057us (10235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.511766:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:0.0:1789583756.513246:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.513383:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313380608 00000100:00100000:3.0:1789583756.513405:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313380608 00002000:00100000:3.0:1789583756.513476:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88b6485c0a80 x1876514313380608/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:472/0 lens 504/0 e 0 to 0 dl 1789583767 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789583756.513504:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b6485c0a80 with x1876514313380608 ext(0->8) 00002000:00010000:3.0:1789583756.513512:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b6485c0a80 00000100:00100000:3.0:1789583756.513550:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:3.0:1789583756.513560:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313380608:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789583756.528438:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313380608:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 14851us (15175us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789583756.528469:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00002000:00100000:2.0:1789583756.528487:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff88b6485c0a80 x1876514313380608/t4294967302(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:472/0 lens 504/448 e 0 to 0 dl 1789583767 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789583756.528499:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b6485c0a80 with x1876514313380608 ext(0->8) 00002000:00010000:2.0:1789583756.528507:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b6485c0a80 00000100:00100000:3.0:1789583756.532459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.534160:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313380736 00000100:00100000:1.0:1789583756.534176:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313380736 00000100:00100000:1.0:1789583756.534381:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:1.0:1789583756.534404:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+58:10459:x1876514313380736:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789583756.582244:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1789583756.582296:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1789583756.582314:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1789583756.582335:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789583756.582346:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b64566acc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789583756.582352:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b64a73dd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b64566ae40 00000020:00080000:0.0:1789583756.582355:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b64a73d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b67ba82000 00000100:00100000:0.0:1789583756.582623:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332275840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789583756.582709:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583756.582766:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789583756.582773:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332275968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789583756.582797:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583756.582884:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332275840 00000100:00100000:0.0:1789583756.582893:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332275840 00000100:00100000:0.0:1789583756.582958:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332275968 00000100:00100000:0.0:1789583756.582962:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332275968 00000100:00100000:0.0:1789583756.582984:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789583756.582994:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332275840:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1789583756.583158:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789583756.583303:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789583756.583322:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789583756.583332:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332275968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789583756.583354:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789583756.583398:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aaae189, atime: 0x6aaae189, ctime: 0x6aaae189, blocks: 0x1 00010000:00010000:3.0:1789583756.583408:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.583441:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1789583756.583447:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583756.583455:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.583477:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.583488:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.583519:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.583540:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789583756.584162:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332275968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 829us (1359us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789583756.584172:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789583756.584213:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583756.584222:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.584232:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583756.584237:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.584247:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.584267:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.584275:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054faf981/0x6d3e73d72c6e33dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.584300:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583756.584309:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583756.584311:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789583756.584469:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b6485c3480/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789583756.584477:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332275968:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789583756.584826:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583756.584995:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10459:x1876514313380736:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 50592us (52548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583756.585028:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 80 00002000:00010000:0.0:1789583756.585569:0:9665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789583756.585575:0:9665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789583756 00002000:00010000:0.0:1789583756.585578:0:9665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789583756.585588:0:9665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789583755 -> 1789583756 00002000:00010000:0.0:1789583756.585590:0:9665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789583756.585652:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332275840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2658us (2942us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789583756.585661:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:3.0:1789583756.585993:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b6485c2d80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789583756.586001:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332275840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789583756.587956:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583756.588217:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313380864 00000100:00100000:0.0:1789583756.588229:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313380864 00000100:00100000:0.0:1789583756.588329:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:0.0:1789583756.588342:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313380864:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789583756.630553:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313380864:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 42197us (42592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583756.630571:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000001:00080000:3.0:1789583756.631380:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1789583756.631397:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789583756.633577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.633707:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313381120 00000100:00100000:3.0:1789583756.633720:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313381120 00000100:00100000:3.0:1789583756.633795:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:3.0:1789583756.633850:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10459:x1876514313381120:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789583756.633985:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583756.634033:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e33c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64b4 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.634059:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:2.0:1789583756.634066:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583756.634109:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.634126:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.634136:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583756.634602:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c60b142 reply state 000000006e928b36 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.634613:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583756.634742:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+14:10459:x1876514313381120:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 936us (1176us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1789583756.634750:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:1.0:1789583756.639364:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583756.639432:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313381248 00000100:00100000:2.0:1789583756.639444:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313381248 00000100:00100000:2.0:1789583756.639518:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:2.0:1789583756.639530:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313381248:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1789583756.639709:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.639725:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.639788:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.639798:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.639803:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.639843:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.639864:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:3.0:1789583756.639885:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583756.639893:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.639900:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e33e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789583756.639921:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789583756.639933:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789583756 -> 1789583754 00002000:00010000:2.0:1789583756.639936:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789583753 00002000:00010000:2.0:1789583756.639939:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789583756 -> 1789583754 00002000:00010000:2.0:1789583756.639941:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789583756.640017:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313381248:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 487us (667us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789583756.640026:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789583756.643767:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.644074:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313381504 00000100:00100000:1.0:1789583756.644086:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313381504 00000100:00100000:1.0:1789583756.644163:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:1.0:1789583756.644176:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10459:x1876514313381504:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789583756.644364:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.644386:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.644397:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.644452:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 13 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.644468:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 13 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583756.644485:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332276096:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583756.644646:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a355f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789583756.647801:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.648030:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332276096:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583756.648070:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.648086:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313381632 00000100:00100000:2.0:1789583756.648096:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313381632 00010000:00010000:2.0:1789583756.648157:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 14 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.648203:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789583756.648214:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:2358:x1876514313381632:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583756.648233:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583756.648251:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 14 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.648265:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 14 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.648303:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e33a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64a6 expref: 14 pid: 5849 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.648323:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:2.0:1789583756.648328:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.648361:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.648370:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.648406:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583756.648478:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.648487:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2358:x1876514313381632:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 273us (700us total) trans 0 rc 0/0 00010000:00010000:3.0:1789583756.648491:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.648501:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00010000:00010000:3.0:1789583756.648533:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.648542:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.648549:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.648556:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.648561:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.648569:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.648588:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:3.0:1789583756.648591:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789583756.648596:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.648602:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e33eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.648651:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+12:10459:x1876514313381504:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 4478us (4912us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789583756.648661:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:2.0:1789583756.651478:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.651562:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313381760 00000100:00100000:3.0:1789583756.651585:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313381760 00000100:00100000:3.0:1789583756.651675:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:3.0:1789583756.651687:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313381760:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789583756.651744:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.651771:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.651780:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583756.651785:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583756.651791:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.651870:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.651897:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 7 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.651915:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332276224:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583756.652127:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583756.657541:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332276224:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583756.657690:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.658590:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.658704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313381888 00000100:00100000:3.0:1789583756.658716:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313381888 00010000:00010000:3.0:1789583756.658766:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 8 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.659033:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:3.0:1789583756.659043:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313381888:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583756.659058:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583756.659085:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 8 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.659095:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 8 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.659117:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019af224b/0x6d3e73d72c6e33d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c2 expref: 8 pid: 6705 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.659151:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583756.659157:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583756.659164:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.659174:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.659214:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583756.659506:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313381888:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 462us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583756.659515:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00010000:00010000:0.0:1789583756.659529:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659540:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659573:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659581:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659589:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659609:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583756.659614:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659625:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659638:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583756.659646:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054faf981/0x6d3e73d72c6e33f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583756.659701:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313381760:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 8017us (8237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583756.659709:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:0.0:1789583756.664287:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583756.664444:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313382144 00000100:00100000:2.0:1789583756.664458:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313382144 00000100:00100000:2.0:1789583756.664542:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:2.0:1789583756.664555:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+12:10459:x1876514313382144:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789583756.664663:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.664686:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.664701:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.665031:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.665044:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.665072:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.665114:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.665136:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 13 pid: 5848 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583756.665153:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332276352:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583756.665256:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789583756.669973:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332276352:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583756.670016:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583756.671182:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583756.671274:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313382272 00000100:00100000:1.0:1789583756.671302:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313382272 00010000:00010000:1.0:1789583756.671353:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 14 pid: 5848 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583756.671399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:1.0:1789583756.671410:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+14:2358:x1876514313382272:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583756.671439:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583756.671448:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 14 pid: 5848 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.671462:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 14 pid: 5848 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.671489:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e33b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ad expref: 14 pid: 5848 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.671511:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:1.0:1789583756.671518:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.671530:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.671539:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.671580:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583756.671615:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.671627:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583756.671657:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2358:x1876514313382272:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 247us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.671677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000001:00080000:3.0:1789583756.672097:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789583756.672359:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789583756.672437:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789583756.672541:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332276480:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789583756.672608:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583756.672646:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f943c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583756.673116:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332276480 00000100:00100000:1.0:1789583756.673126:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332276480 00000100:00100000:1.0:1789583756.673338:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583756.673349:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876514332276480:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789583756.673467:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876514332276480:12345-0@lo:1000:mdt00_002.0 Request processed in 120us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583756.673474:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583756.673544:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1789583756.673551:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b6485c2d80, transno 4294967303 00000100:00100000:3.0:1789583756.673575:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332276480:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789583756.674399:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1789583756.674499:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332276608:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789583756.674554:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583756.675499:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583756.675551:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332276608 00000100:00100000:0.0:1789583756.675563:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332276608 00000100:00100000:0.0:1789583756.675615:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789583756.675625:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876514332276608:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789583756.675918:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1876514332276608:12345-0@lo:1000:mdt00_002.0 Request processed in 292us (1361us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789583756.675927:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583756.676059:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332276608:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789583756.676109:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676120:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676129:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676135:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.676151:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676161:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676181:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b643e76700) 00010000:00010000:3.0:1789583756.676185:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583756.676190:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676197:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3400 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676245:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676261:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676268:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676273:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583756.676277:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676284:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676293:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583756.676295:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583756.676299:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676304:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e332e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676358:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676375:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676386:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676434:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.676458:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 16 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.676475:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332276736:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583756.676565:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583756.679178:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67baaf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332276736:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583756.679219:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583756.680835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.681164:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313382400 00000100:00100000:3.0:1789583756.681175:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313382400 00010000:00010000:3.0:1789583756.681224:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 17 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583756.681312:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:3.0:1789583756.681324:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+17:2359:x1876514313382400:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583756.681344:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583756.681352:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 17 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.681364:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 17 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.681390:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e334a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6491 expref: 17 pid: 5850 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.681437:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583756.681444:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.681455:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.681464:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.681499:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583756.681576:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+16:2359:x1876514313382400:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 254us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583756.681584:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00010000:00010000:2.0:1789583756.681655:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681664:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681679:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681686:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681693:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681707:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583756.681712:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681721:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681741:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:2.0:1789583756.681744:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583756.681749:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681755:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3407 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681769:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681775:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681780:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681785:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583756.681788:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681794:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681835:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b64336a700) 00010000:00010000:2.0:1789583756.681837:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789583756.681841:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583756.681848:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e33f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583756.682214:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583756.682220:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583756.682270:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789583756.682276:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789583756.682360:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10459:x1876514313382144:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 17806us (18094us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789583756.682370:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000020:00080000:2.0:1789583756.682374:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789583756.685008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583756.685163:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313382656 00000100:00100000:3.0:1789583756.685176:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313382656 00000100:00100000:3.0:1789583756.685244:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:3.0:1789583756.685256:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10459:x1876514313382656:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789583756.686461:0:11497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789583756.686594:0:11497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789583756.686662:0:11497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.686683:0:11497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.686698:0:11497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.686720:0:11497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.686726:0:11497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.686785:0:11497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583756.686890:0:11497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789583756.687035:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+17:10459:x1876514313382656:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1777us (2036us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789583756.687046:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000020:00080000:3.0:1789583756.687053:0:11497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789583756.687970:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583756.687982:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.687992:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583756.687998:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.688008:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.688036:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff88b64336a900) 00010000:00010000:1.0:1789583756.688040:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789583756.688046:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.688053:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e340e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583756.688078:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583756.688093:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583756.688095:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583756.839476:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583757.863319:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789583758.107286:0:12069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583758.107297:0:12069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583758.107347:0:12069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789583758.107354:0:12069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789583758.219125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.219224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313382912 00000100:00100000:3.0:1789583758.219238:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313382912 00000100:00100000:3.0:1789583758.219320:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:3.0:1789583758.219332:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+17:10477:x1876514313382912:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583758.219363:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583758.219389:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64c9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.219540:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e341c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.219559:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e341c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.219592:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e341c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583758.219607:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789583758.219765:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c9 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.219787:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e341c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c9 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.219797:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583758.219800:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789583758.219839:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03800, rc 0) 00000100:00100000:3.0:1789583758.219913:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+19:10477:x1876514313382912:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 584us (800us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789583758.219921:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00080000:1.0:1789583758.220186:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583758.222170:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.222254:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313383040 00000100:00100000:2.0:1789583758.222266:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313383040 00000100:00100000:2.0:1789583758.222336:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:2.0:1789583758.222348:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+19:10477:x1876514313383040:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789583758.222445:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.222474:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.222503:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.222523:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.222531:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.222538:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223072:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223085:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223092:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583758.223143:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223158:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223166:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223174:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223192:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.223197:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223206:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223221:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583758.223224:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.223230:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223236:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e342a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223250:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223256:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223261:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223266:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.223268:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223274:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223295:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.223297:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.223300:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223306:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223321:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223327:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223333:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223339:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.223342:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223348:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223356:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4c00) 00010000:00010000:2.0:1789583758.223358:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.223361:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.223366:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.223664:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+19:10477:x1876514313383040:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1314us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583758.223673:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:0.0:1789583758.280449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.280613:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313383296 00000100:00100000:2.0:1789583758.280627:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313383296 00000100:00100000:2.0:1789583758.280698:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:2.0:1789583758.280711:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+19:10480:x1876514313383296:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583758.280738:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.280764:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e343f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64d0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.281969:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.281997:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282011:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282031:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282039:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282046:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282399:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282422:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282431:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583758.282443:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789583758.282575:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282584:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282593:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282600:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.282605:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282614:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282628:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583758.282631:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.282637:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282654:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282665:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282671:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282677:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282682:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.282686:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282693:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282702:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4c00) 00010000:00010000:2.0:1789583758.282705:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.282708:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282714:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e344d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282772:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e343f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282797:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.282847:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.282850:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583758.282852:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1400, rc 0) 00000100:00100000:2.0:1789583758.282937:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10480:x1876514313383296:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2228us (2501us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789583758.282947:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:1.0:1789583758.297699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.297774:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313383424 00000100:00100000:3.0:1789583758.297787:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313383424 00000100:00100000:3.0:1789583758.298021:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:3.0:1789583758.298035:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10480:x1876514313383424:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789583758.298124:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298145:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298160:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298212:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298221:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298228:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298236:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583758.298241:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298249:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298264:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:3.0:1789583758.298268:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583758.298275:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.298282:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583758.298379:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10480:x1876514313383424:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 347us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583758.298388:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:0.0:1789583758.304106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.306275:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313383680 00000100:00100000:2.0:1789583758.306293:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313383680 00000100:00100000:2.0:1789583758.306505:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:2.0:1789583758.306519:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10480:x1876514313383680:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583758.306854:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+22:10480:x1876514313383680:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 337us (2762us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789583758.306863:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:0.0:1789583758.349011:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.349953:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313383936 00000100:00100000:2.0:1789583758.349971:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313383936 00000100:00100000:2.0:1789583758.350120:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:2.0:1789583758.350134:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+22:10001:x1876514313383936:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583758.350171:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.350199:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3469 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64d7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.350348:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.350368:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.350395:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.350452:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.350468:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 23 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.350486:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332276864:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583758.350618:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650ea5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789583758.361319:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.361615:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313384064 00000100:00100000:3.0:1789583758.361629:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313384064 00010000:00010000:3.0:1789583758.361686:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 24 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583758.361764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:3.0:1789583758.361776:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+24:2358:x1876514313384064:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583758.361796:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583758.361850:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 24 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.361865:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 24 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.361894:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:3.0:1789583758.361900:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.361910:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.361918:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.361941:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583758.362014:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+24:2358:x1876514313384064:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 240us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583758.362023:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00010000:00010000:2.0:1789583758.362865:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3454 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d0 expref: 23 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.362890:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332276864:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583758.362918:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.362929:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.362936:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583758.362962:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789583758.363363:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.363400:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.363519:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.363524:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789583758.363527:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583758.363589:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+23:10001:x1876514313383936:12345-192.168.203.46@tcp:101:bash.0 Request processed in 13457us (14592us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789583758.363600:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:1.0:1789583758.367070:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.368663:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313384320 00000100:00100000:2.0:1789583758.368685:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313384320 00000100:00100000:2.0:1789583758.368849:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:2.0:1789583758.368862:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+23:10001:x1876514313384320:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:2.0:1789583758.369227:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.369248:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.369262:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583758.369339:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789583758.369368:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c413d2a reply state 000000001078dd77 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.369378:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789583758.369464:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789583758.369665:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10001:x1876514313384320:12345-192.168.203.46@tcp:36:bash.0 Request processed in 805us (2664us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789583758.369674:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 89 00000020:00080000:2.0:1789583758.369681:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789583758.374680:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.374770:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313384448 00000100:00100000:2.0:1789583758.374784:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313384448 00000100:00100000:2.0:1789583758.374894:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 90 00000100:00100000:2.0:1789583758.374905:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10001:x1876514313384448:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583758.374937:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.374965:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64de expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.375115:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64de expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.375133:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3485 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64de expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.375157:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.375161:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583758.375166:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1600, rc 0) 00000100:00100000:2.0:1789583758.375233:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:10001:x1876514313384448:12345-192.168.203.46@tcp:101:bash.0 Request processed in 329us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583758.375241:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 90 00010000:00010000:1.0:1789583758.375980:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.375993:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.376001:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.376274:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583758.376280:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.376290:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.376306:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:1.0:1789583758.376310:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583758.376314:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.376321:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e347e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583758.379041:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.379214:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313384576 00000100:00100000:2.0:1789583758.379230:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313384576 00000100:00100000:2.0:1789583758.379321:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:2.0:1789583758.379343:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:10001:x1876514313384576:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583758.379378:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.379419:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64e5 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789583758.379459:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aaae18a, atime: 0x6aaae189, ctime: 0x6aaae18a, blocks: 0xb 00010000:00010000:2.0:1789583758.379491:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1789583758.379496:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583758.379506:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.379529:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 7 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.379544:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0400, rc 0) 00000100:00100000:2.0:1789583758.379638:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:10001:x1876514313384576:12345-192.168.203.46@tcp:101:bash.0 Request processed in 298us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583758.379645:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00080000:1.0:1789583758.380339:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583758.384228:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.384699:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313384704 00000100:00100000:0.0:1789583758.384714:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313384704 00002000:00010000:0.0:1789583758.384976:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789583758.384983:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b541c5d500 with x1876514313384704 ext(0->18446744073709551615) 00002000:00010000:0.0:1789583758.384999:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b541c5d500. 00000100:00100000:0.0:1789583758.385131:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789583758.385144:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313384704:12345-192.168.203.46@tcp:10:bash.0 00002000:00010000:0.0:1789583758.385524:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789583758.385529:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789583754 -> 1789583758 00002000:00010000:0.0:1789583758.385531:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789583753 -> 1789583753 00002000:00010000:0.0:1789583758.385533:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789583754 -> 1789583758 00002000:00010000:0.0:1789583758.385536:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789583758.385687:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313384704:12345-192.168.203.46@tcp:10:bash.0 Request processed in 545us (1474us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789583758.385696:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00002000:00010000:0.0:1789583758.385701:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789583758.385704:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b541c5d500 with x1876514313384704 ext(0->18446744073709551615) 00002000:00010000:0.0:1789583758.385710:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b541c5d500. 00000100:00100000:3.0:1789583758.464278:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.464481:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313384832 00000100:00100000:2.0:1789583758.464496:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313384832 00000100:00100000:2.0:1789583758.464577:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:2.0:1789583758.464590:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10494:x1876514313384832:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789583758.464689:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.464712:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.464759:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.464779:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.464787:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.464795:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465751:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465778:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465791:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583758.465875:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465891:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465899:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465906:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465913:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583758.465918:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465926:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465940:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583758.465943:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583758.465949:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465957:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3493 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465981:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465987:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465994:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.465999:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583758.466114:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466123:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466131:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4900) 00010000:00010000:3.0:1789583758.466133:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583758.466137:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466143:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e349a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466159:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466165:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466170:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466182:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583758.466185:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466191:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466200:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:3.0:1789583758.466202:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583758.466204:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.466209:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583758.466384:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10494:x1876514313384832:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1791us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583758.466415:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 91 00000100:00100000:2.0:1789583758.498960:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.499172:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313385088 00000100:00100000:3.0:1789583758.499187:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313385088 00000100:00100000:3.0:1789583758.499269:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:3.0:1789583758.499280:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+27:10497:x1876514313385088:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583758.499308:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583758.499335:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64ec expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.499438:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.499476:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.499500:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.499650:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.499660:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.499669:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500677:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e34bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500692:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e34bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500703:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e34bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583758.500715:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789583758.500860:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500869:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500878:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500897:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.500903:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500912:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500927:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583758.500930:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.500937:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500944:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e34af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500961:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500968:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500974:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500980:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.500983:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.500988:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.501218:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b64336aa00) 00010000:00010000:2.0:1789583758.501221:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.501225:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.501232:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e34b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.501296:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e34a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ec expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.501313:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e34bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ec expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.501322:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.501324:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789583758.501327:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1800, rc 0) 00000100:00100000:2.0:1789583758.501494:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10497:x1876514313385088:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2215us (2548us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789583758.501505:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:1.0:1789583758.505777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.505951:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313385216 00000100:00100000:0.0:1789583758.505964:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313385216 00000100:00100000:0.0:1789583758.506028:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:0.0:1789583758.506039:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10497:x1876514313385216:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789583758.506133:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.506153:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.506164:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.506205:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.506220:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 29 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.506236:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332276992:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583758.506339:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645fa8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583758.510597:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332276992:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583758.510641:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583758.512630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.513921:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313385472 00000100:00100000:3.0:1789583758.513940:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313385472 00000100:00100000:1.0:1789583758.514084:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789583758.514101:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+30:5597:x1876514313385472:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789583758.514560:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+31:5597:x1876514313385472:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 463us (1941us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789583758.514569:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:2.0:1789583758.521684:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.521799:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313385600 00000100:00100000:0.0:1789583758.521846:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313385600 00010000:00010000:0.0:1789583758.521900:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 31 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.521955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:0.0:1789583758.521967:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+31:2359:x1876514313385600:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583758.522022:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583758.522031:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 31 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.522047:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 31 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.522075:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3470 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64d7 expref: 31 pid: 5848 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.522095:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583758.522101:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.522112:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.522122:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.522167:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583758.522231:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+30:2359:x1876514313385600:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 267us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583758.522239:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00010000:00010000:2.0:1789583758.522666:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522676:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522717:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522734:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522741:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522748:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.522753:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522761:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522771:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.522774:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789583758.522778:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.522785:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e34cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.522949:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10497:x1876514313385216:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 16909us (17184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583758.522959:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:2.0:1789583758.535232:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.535295:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313385856 00000100:00100000:0.0:1789583758.535309:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313385856 00000100:00100000:0.0:1789583758.535380:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789583758.535393:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+29:10497:x1876514313385856:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583758.536971:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+30:10497:x1876514313385856:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 1570us (1741us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789583758.536985:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:1.0:1789583758.635177:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.635740:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313386112 00000100:00100000:2.0:1789583758.635754:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313386112 00000100:00100000:2.0:1789583758.635872:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:2.0:1789583758.635885:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+30:10508:x1876514313386112:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:2.0:1789583758.635938:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.635979:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e34d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64f3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.636070:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.636088:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.636103:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.636119:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.636127:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.636134:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.639508:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e34e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.639545:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e34e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.639559:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e34e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583758.639978:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789583758.640133:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640154:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640161:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640167:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.640171:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640178:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640190:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583758.640193:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.640196:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640201:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e34d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640228:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640234:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640239:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.640243:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583758.641171:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.641180:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.641191:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4b00) 00010000:00010000:2.0:1789583758.641194:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.641197:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.641203:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e34e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.641498:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e34d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64f3 expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.641515:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e34e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64f3 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.641523:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.641525:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583758.641528:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1a00, rc 0) 00000100:00100000:2.0:1789583758.641702:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10508:x1876514313386112:12345-192.168.203.46@tcp:101:cat.0 Request processed in 5819us (6540us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789583758.641711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:2.0:1789583758.652896:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.653176:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313386368 00000100:00100000:0.0:1789583758.653186:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313386368 00000100:00100000:0.0:1789583758.653240:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789583758.653320:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10508:x1876514313386368:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:0.0:1789583758.653601:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+33:10508:x1876514313386368:12345-192.168.203.46@tcp:35:cat.0 Request processed in 285us (712us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789583758.653609:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:0.0:1789583758.682967:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583758.683862:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313386624 00000100:00100000:1.0:1789583758.683879:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313386624 00000100:00100000:1.0:1789583758.683976:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 95 00000100:00100000:1.0:1789583758.683989:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+33:10509:x1876514313386624:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:1.0:1789583758.684073:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789583758.684108:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e34e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64f3 expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684136:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e34bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64ec expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684148:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64de expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684182:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:1.0:1789583758.684197:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583758.684226:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684242:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684253:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684268:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684274:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.684280:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.686573:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.686595:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.686608:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583758.687692:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1789583758.687704:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315671897144ns, next at 316671894358ns, rc = 0 00010000:00010000:1.0:1789583758.691912:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.691935:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.691947:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.691955:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.691961:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.691968:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.691994:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583758.692114:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583758.692123:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.692130:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583758.692134:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.692141:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.692154:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583758.692157:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789583758.692162:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.692180:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e350a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.692196:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583758.692198:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583758.692199:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583758.692424:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692432:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692437:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692443:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583758.692447:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692453:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692470:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583758.692472:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789583758.692476:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692482:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3503 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692505:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692511:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692517:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692521:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbe00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583758.692524:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692530:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692537:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583758.692540:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583758.692543:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.692548:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbe00/0x6d3e73d72c6e34f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583758.692569:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fafc24a7 reply state 00000000845e14c7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583758.692577:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583758.692668:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+32:10509:x1876514313386624:12345-192.168.203.46@tcp:36:rm.0 Request processed in 8679us (9708us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789583758.692678:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 95 00010000:00010000:3.0:1789583758.694290:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.694309:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.694317:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.694325:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583758.694330:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.694338:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.694357:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b645246e00) 00010000:00010000:3.0:1789583758.694361:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583758.694366:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.694373:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e34fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.753166:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.753536:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313386880 00000100:00100000:2.0:1789583758.753550:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313386880 00000100:00100000:2.0:1789583758.753629:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:2.0:1789583758.753659:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+31:10515:x1876514313386880:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583758.753692:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.753717:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3511 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec64fa expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.753944:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.753964:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.753990:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.754017:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.754026:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.754033:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789583758.758923:0:5849:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789583758.759169:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759187:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759201:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583758.759226:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583758.759235:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:2.0:1789583758.759257:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759266:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759273:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583758.759275:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00010000:00010000:2.0:1789583758.759290:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00000040:00080000:1.0:1789583758.759292:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789583758.759296:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759304:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759324:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583758.759327:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583758.759333:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.759338:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3518 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583758.759356:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000002f91f0 reply state 000000009a1ed8d7 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.759366:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789583758.763339:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3511 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.763419:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.763431:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583758.763435:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583758.763439:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1600, rc 0) 00000100:00100000:2.0:1789583758.763547:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+34:10515:x1876514313386880:12345-192.168.203.46@tcp:101:bash.0 Request processed in 9890us (10395us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789583758.763557:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:2.0:1789583758.770891:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.771743:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387008 00000100:00100000:0.0:1789583758.771760:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387008 00010000:00010000:1.0:1789583758.771945:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.771961:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.771969:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.771977:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583758.771982:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.771991:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.772022:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4b00) 00010000:00010000:1.0:1789583758.772025:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789583758.772031:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:0.0:1789583758.772043:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313387008:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789583758.772046:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.772052:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e351f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.772066:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583758.772090:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6501 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583758.772121:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789583758.772146:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1789583758.772151:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583758.772162:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.772183:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.772222:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca400, rc 0) 00000100:00100000:0.0:1789583758.772374:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313387008:12345-192.168.203.46@tcp:101:bash.0 Request processed in 332us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583758.772382:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00080000:2.0:1789583758.772571:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583758.777634:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.777726:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387136 00000100:00100000:2.0:1789583758.777740:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387136 00000100:00100000:2.0:1789583758.777852:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:2.0:1789583758.777862:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:10515:x1876514313387136:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583758.777888:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583758.777912:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6508 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.777963:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.777971:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583758.777975:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583758.777980:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.778042:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.778058:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 9 pid: 6704 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.778072:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1876514332277120:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583758.778179:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583758.781570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.781794:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387264 00000100:00100000:3.0:1789583758.781864:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387264 00010000:00010000:3.0:1789583758.781915:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 10 pid: 6704 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583758.781957:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789583758.781969:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2358:x1876514313387264:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583758.781988:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583758.782017:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 10 pid: 6704 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.782034:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 10 pid: 6704 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.782067:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583758.782072:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583758.782083:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 10 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.782094:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 10 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.782163:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 10 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583758.782195:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1876514332277248:192.168.203.46@tcp:105: 00000100:00100000:3.0:1789583758.782294:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650f94300 going to sleep for 11 seconds 00010000:00010000:2.0:1789583758.784529:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e3534 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6501 expref: 10 pid: 6704 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.784560:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1876514332277120:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583758.784600:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 9 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.784619:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583758.784706:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:10515:x1876514313387136:12345-192.168.203.46@tcp:101:bash.0 Request processed in 6843us (7085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583758.784715:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:3.0:1789583758.788918:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5833:1876514332277248:192.168.203.46@tcp:105: 00010000:00010000:3.0:1789583758.788955:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583758.791704:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313387264:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 9720us (10131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583758.791726:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:1.0:1789583758.796797:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.797028:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387520 00000100:00100000:2.0:1789583758.797042:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387520 00000100:00100000:2.0:1789583758.797116:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:2.0:1789583758.797128:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+33:10515:x1876514313387520:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789583758.797616:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+34:10515:x1876514313387520:12345-192.168.203.46@tcp:35:bash.0 Request processed in 488us (832us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789583758.797625:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00010000:00010000:3.0:1789583758.891245:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583758.905076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583758.905156:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.905329:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387776 00000100:00100000:0.0:1789583758.905339:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387776 00000100:00100000:0.0:1789583758.905488:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:0.0:1789583758.905499:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313387776:12345-192.168.203.46@tcp:16:kworker.0 00000100:00100000:0.0:1789583758.905618:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313387776:12345-192.168.203.46@tcp:16:kworker.0 Request processed in 120us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583758.905627:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789583758.905744:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387648 00000100:00100000:3.0:1789583758.905750:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387648 00002000:00100000:3.0:1789583758.905785:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88b668f9c000 x1876514313387648/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:474/0 lens 504/0 e 0 to 0 dl 1789583769 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789583758.905795:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b668f9c000 with x1876514313387648 ext(0->8) 00002000:00010000:3.0:1789583758.905802:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88b668f9c000 00000100:00100000:3.0:1789583758.905850:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789583758.905861:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313387648:12345-192.168.203.46@tcp:4:bash.0 00000100:00100000:2.0:1789583758.906940:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2359:x1876514313387648:12345-192.168.203.46@tcp:4:bash.0 Request processed in 1076us (1778us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789583758.906951:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00002000:00100000:2.0:1789583758.906961:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff88b668f9c000 x1876514313387648/t4294967302(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:474/0 lens 504/448 e 0 to 0 dl 1789583769 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789583758.906971:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b668f9c000 with x1876514313387648 ext(0->8) 00002000:00010000:2.0:1789583758.906976:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88b668f9c000 00000001:00080000:3.0:1789583758.943401:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1789583758.943428:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1789583758.943435:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1789583758.963784:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.963913:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313387904 00000100:00100000:2.0:1789583758.963932:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313387904 00000100:00100000:3.0:1789583758.964121:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:3.0:1789583758.964132:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+34:10532:x1876514313387904:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583758.964163:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583758.964185:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec650f expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.964246:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.964260:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.964285:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583758.964319:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789583758.964323:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583758.964339:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.964363:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec650f expref: 36 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.964384:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec650f expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.964392:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583758.964396:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583758.964400:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03c00, rc 0) 00000100:00100000:3.0:1789583758.964467:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10532:x1876514313387904:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 336us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583758.964474:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:1.0:1789583758.967398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.967533:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313388160 00000100:00100000:0.0:1789583758.967544:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313388160 00000100:00100000:0.0:1789583758.967607:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:0.0:1789583758.967617:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+35:10532:x1876514313388160:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583758.967636:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583758.967656:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e3550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6516 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.967749:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.967763:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.967775:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583758.967799:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789583758.967957:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e3550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6516 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.967976:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6516 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.967990:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583758.967993:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583758.967996:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca400, rc 0) 00000100:00100000:0.0:1789583758.968060:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+37:10532:x1876514313388160:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 444us (673us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789583758.968067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:2.0:1789583758.970888:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583758.970933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583758.971101:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313388416 00000100:00100000:3.0:1789583758.971110:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313388416 00000100:00100000:0.0:1789583758.971152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313388544 00000100:00100000:0.0:1789583758.971157:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313388544 00000100:00100000:3.0:1789583758.971163:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:3.0:1789583758.971172:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+38:10532:x1876514313388416:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583758.971192:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789583758.971204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00010000:00010000:3.0:1789583758.971211:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3565 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec651d expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.971211:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+38:2358:x1876514313388544:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583758.971222:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583758.971241:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6516 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.971254:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583758.971259:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583758.971308:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+38:2358:x1876514313388544:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 97us (374us total) trans 0 rc 0/0 00010000:00010000:3.0:1789583758.971310:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e356c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.971315:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00010000:00010000:3.0:1789583758.971322:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e356c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.971331:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e356c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583758.971343:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789583758.971471:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e3565 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec651d expref: 39 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.971486:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e356c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec651d expref: 38 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583758.971493:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:3.0:1789583758.971496:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789583758.971498:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03600, rc 0) 00000100:00100000:3.0:1789583758.971537:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+38:10532:x1876514313388416:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 365us (658us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789583758.971543:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:2.0:1789583758.980928:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.981015:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313388672 00000100:00100000:0.0:1789583758.981025:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313388672 00000100:00100000:0.0:1789583758.981324:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:0.0:1789583758.981335:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313388672:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:0.0:1789583758.981380:0:9665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.981399:0:9665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.981417:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583758.981421:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583758.981425:0:9665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.981459:0:9665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.981472:0:9665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 8 pid: 6702 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.981487:0:9665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9665:1876514332277376:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583758.981580:0:9665:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583758.987343:0:9665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9665:1876514332277376:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583758.987371:0:9665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.988868:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583758.989007:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313388800 00000100:00100000:0.0:1789583758.989017:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313388800 00010000:00010000:0.0:1789583758.989053:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 9 pid: 6702 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583758.989113:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583758.989123:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2359:x1876514313388800:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583758.989139:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789583758.989157:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789583758.989160:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789583758 00002000:00010000:0.0:1789583758.989162:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789583758 00010000:00010000:0.0:1789583758.989168:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 9 pid: 6702 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.989182:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 9 pid: 6702 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.989206:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e353b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6508 expref: 9 pid: 6702 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.989222:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583758.989226:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583758.989232:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.989242:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583758.989274:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583758.989340:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313388800:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 218us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583758.989349:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00010000:00010000:2.0:1789583758.989469:0:9665:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989478:0:9665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989513:0:9665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989520:0:9665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989528:0:9665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989534:0:9665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752ca400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583758.989539:0:9665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989547:0:9665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989560:0:9665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583758.989567:0:9665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000530653a9/0x6d3e73d72c6e357a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583758.989615:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313388672:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 8282us (8696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583758.989622:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:0.0:1789583758.994345:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583758.994521:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313389056 00000100:00100000:1.0:1789583758.994532:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313389056 00000100:00100000:1.0:1789583758.994591:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:1.0:1789583758.994601:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+38:10532:x1876514313389056:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:1.0:1789583758.994673:0:5851:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e356c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec651d expref: 38 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583758.995209:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789583758.995252:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789583758.995552:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789583758.995603:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.995618:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.995626:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.995671:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 42 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583758.995686:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 42 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583758.995698:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332277504:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583758.995782:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a355840 going to sleep for 11 seconds 00000100:00100000:1.0:1789583759.000078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.000379:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313389184 00000100:00100000:0.0:1789583759.000389:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313389184 00010000:00010000:0.0:1789583759.000440:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 43 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583759.000479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:0.0:1789583759.000489:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+43:2358:x1876514313389184:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583759.000503:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583759.000510:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 43 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.000524:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 43 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.000545:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583759.000551:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.000560:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.000567:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.000584:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583759.000659:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+43:2358:x1876514313389184:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 171us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.000667:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00010000:00010000:3.0:1789583759.002086:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64fa expref: 42 pid: 5849 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583759.002109:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332277504:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583759.002132:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.002154:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.002160:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583759.002411:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789583759.002625:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789583759.003119:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332277632:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789583759.003180:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583759.003265:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6618d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583759.003450:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332277632 00000100:00100000:0.0:1789583759.003457:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332277632 00000100:00100000:0.0:1789583759.003557:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583759.003567:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332277632:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583759.003655:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332277632:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.003663:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583759.003743:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1789583759.003750:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1789583759.003766:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b6485c3480, transno 4294967301 00000100:00100000:3.0:1789583759.003782:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332277632:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789583759.004272:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789583759.004339:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332277760:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789583759.004374:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583759.004392:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c80600 going to sleep for 11 seconds 00000100:00100000:0.0:1789583759.004893:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332277760 00000100:00100000:0.0:1789583759.004995:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332277760 00000100:00100000:0.0:1789583759.005084:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789583759.005092:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332277760:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583759.005246:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5851:x1876514332277760:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 154us (871us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789583759.005254:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789583759.005293:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332277760:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789583759.006067:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789583759.006122:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.006133:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.006142:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.006148:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583759.006164:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.006173:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.006188:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583759.006191:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789583759.006196:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.006202:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3581 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789583759.006386:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789583759.006489:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1789583759.006499:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315990692806ns, next at 316990690596ns, rc = 0 00000001:00080000:0.0:1789583759.006506:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789583759.006539:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583759.006543:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789583759.006549:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e356c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec651d expref: 46 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789583759.007140:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583759.007419:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+45:10532:x1876514313389056:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 12817us (13080us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789583759.007429:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000020:00080000:0.0:1789583759.007435:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789583759.018195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.018294:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313389312 00000100:00100000:2.0:1789583759.018304:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313389312 00000100:00100000:2.0:1789583759.018359:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:2.0:1789583759.018369:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+45:10532:x1876514313389312:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583759.018392:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583759.018431:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6524 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.018493:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6524 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.018509:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3588 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6524 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.018528:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.018531:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583759.018535:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0200, rc 0) 00000100:00100000:2.0:1789583759.018593:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+46:10532:x1876514313389312:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 224us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.018600:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:2.0:1789583759.025149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.025339:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313389568 00000100:00100000:0.0:1789583759.025350:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313389568 00000100:00100000:0.0:1789583759.025421:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:0.0:1789583759.025431:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+46:10532:x1876514313389568:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789583759.025735:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10532:x1876514313389568:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 304us (719us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789583759.025742:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:1.0:1789583759.123583:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.123740:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313389696 00000100:00100000:3.0:1789583759.123750:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313389696 00000100:00100000:3.0:1789583759.123843:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:3.0:1789583759.123854:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10542:x1876514313389696:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789583759.124308:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124326:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124338:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124366:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124374:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124382:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124478:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124487:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124494:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583759.124534:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124547:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124554:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124560:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124566:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.124570:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124584:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124596:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583759.124600:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.124605:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124610:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e358f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124623:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124735:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124742:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124747:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.124750:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124756:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124763:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4900) 00010000:00010000:2.0:1789583759.124765:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.124768:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124784:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3596 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.124801:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.125081:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.125087:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.125092:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.125095:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.125101:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.125109:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.125111:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.125114:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.125120:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e359d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.125205:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10542:x1876514313389696:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1351us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.125215:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:1.0:1789583759.188326:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.188423:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313389952 00000100:00100000:3.0:1789583759.188434:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313389952 00000100:00100000:3.0:1789583759.188494:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:3.0:1789583759.188504:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+47:10545:x1876514313389952:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583759.188537:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.188558:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec652b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188633:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188648:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188659:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188672:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188678:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188684:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188848:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188857:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188864:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583759.188873:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789583759.188977:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188985:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.188991:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189007:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583759.189013:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189020:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189033:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583759.189036:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583759.189041:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189048:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189062:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189067:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189073:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189077:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583759.189086:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189092:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189100:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b64336a700) 00010000:00010000:3.0:1789583759.189102:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583759.189105:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.189111:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.190411:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.190464:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.190473:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583759.190476:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583759.190479:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03600, rc 0) 00000100:00100000:3.0:1789583759.190569:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10545:x1876514313389952:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2066us (2251us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789583759.190578:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:1.0:1789583759.197309:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.197590:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313390080 00000100:00100000:3.0:1789583759.197645:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313390080 00000100:00100000:3.0:1789583759.197878:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:3.0:1789583759.197892:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10545:x1876514313390080:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789583759.198010:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198033:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198047:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198081:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198088:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198096:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198103:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583759.198108:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198117:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198130:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583759.198133:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583759.198139:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.198146:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583759.198380:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10545:x1876514313390080:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 489us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.198388:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:1.0:1789583759.203232:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.203431:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313390336 00000100:00100000:3.0:1789583759.203446:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313390336 00000100:00100000:3.0:1789583759.203522:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:3.0:1789583759.203535:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+49:10545:x1876514313390336:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789583759.204220:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10545:x1876514313390336:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 685us (1001us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789583759.204230:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:1.0:1789583759.277777:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.279651:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313390592 00000100:00100000:2.0:1789583759.279672:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313390592 00000100:00100000:2.0:1789583759.279772:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:2.0:1789583759.279785:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10555:x1876514313390592:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583759.279830:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583759.279834:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789583759.279869:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e3549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec650f expref: 50 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.279895:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583759.279901:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583759.279918:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e35ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6532 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.280053:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.280072:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.280080:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.280133:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.280149:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 50 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.280186:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332277888:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583759.280338:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583759.283993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.284126:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332277888:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583759.284176:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583759.284201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313390720 00000100:00100000:0.0:1789583759.284212:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313390720 00010000:00010000:0.0:1789583759.284262:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 51 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583759.284310:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:0.0:1789583759.284321:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+51:2359:x1876514313390720:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583759.284340:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583759.284349:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 51 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.284363:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 51 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.284392:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e35b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec652b expref: 51 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.284422:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583759.284428:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.284439:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.284448:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.284498:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583759.284566:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+50:2359:x1876514313390720:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 247us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.284575:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00010000:00010000:2.0:1789583759.284681:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.284689:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583759.284713:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789583759.284958:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e35ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.284978:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.284986:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.284989:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789583759.284991:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583759.285024:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10555:x1876514313390592:12345-192.168.203.46@tcp:101:bash.0 Request processed in 5242us (7262us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789583759.285031:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 104 00000100:00100000:1.0:1789583759.290563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.290678:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313390976 00000100:00100000:2.0:1789583759.290709:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313390976 00000100:00100000:2.0:1789583759.290790:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 105 00000100:00100000:2.0:1789583759.290802:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+50:10555:x1876514313390976:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:2.0:1789583759.291369:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.291392:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.291415:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583759.291486:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1789583759.291513:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077a4191c reply state 0000000024c0e356 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.291524:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583759.291649:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10555:x1876514313390976:12345-192.168.203.46@tcp:36:bash.0 Request processed in 846us (1096us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789583759.291658:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 105 00000020:00080000:2.0:1789583759.291665:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789583759.294697:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.294723:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.294732:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.294738:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583759.294744:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.294753:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.294774:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583759.294777:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583759.294849:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.294857:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e35e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.295343:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.295785:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313391104 00000100:00100000:3.0:1789583759.295797:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313391104 00000100:00100000:3.0:1789583759.295958:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 106 00000100:00100000:3.0:1789583759.295975:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10555:x1876514313391104:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789583759.296017:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.296041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6539 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.296156:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.296179:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.296189:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.296231:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.296245:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 53 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583759.296262:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332278016:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583759.296437:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583759.307963:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.308163:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313391232 00000100:00100000:0.0:1789583759.308176:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313391232 00010000:00010000:0.0:1789583759.308230:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 54 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583759.308299:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:0.0:1789583759.308311:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:2359:x1876514313391232:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583759.308332:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583759.308341:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 54 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.308356:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 54 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.308384:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583759.308391:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.308413:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.308423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.308472:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583759.308548:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:2359:x1876514313391232:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 239us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.308557:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00010000:00010000:3.0:1789583759.315635:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e35d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6532 expref: 53 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583759.315670:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332278016:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583759.315705:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.318980:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.319003:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583759.319070:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789583759.319075:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583759.319103:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.319188:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.319314:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 52 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.319325:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.319328:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583759.319333:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03400, rc 0) 00000100:00100000:2.0:1789583759.319446:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10555:x1876514313391104:12345-192.168.203.46@tcp:101:bash.0 Request processed in 23473us (24107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.319456:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 106 00000100:00100000:1.0:1789583759.321761:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.323000:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313391488 00000100:00100000:2.0:1789583759.323016:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313391488 00000100:00100000:2.0:1789583759.323148:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:2.0:1789583759.323162:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:10555:x1876514313391488:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:2.0:1789583759.323828:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10555:x1876514313391488:12345-192.168.203.46@tcp:35:bash.0 Request processed in 350us (1760us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789583759.323841:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:1.0:1789583759.375895:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.378006:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313391616 00000100:00100000:3.0:1789583759.378028:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313391616 00000100:00100000:3.0:1789583759.378116:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 107 00000100:00100000:3.0:1789583759.378128:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+53:10561:x1876514313391616:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583759.378162:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.378190:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6540 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.378291:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.378308:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.378322:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583759.378368:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789583759.378372:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583759.378394:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.378459:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e35f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6540 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.378592:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6540 expref: 54 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.378602:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:3.0:1789583759.378605:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583759.378610:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03e00, rc 0) 00000100:00100000:3.0:1789583759.378883:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10561:x1876514313391616:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 755us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.378891:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 107 00000100:00100000:1.0:1789583759.390014:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.390127:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313391744 00000100:00100000:2.0:1789583759.390139:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313391744 00000100:00100000:2.0:1789583759.390224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:2.0:1789583759.390235:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10561:x1876514313391744:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583759.390270:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583759.390299:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6547 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390409:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390428:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390443:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390460:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390467:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390606:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390715:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390725:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.390731:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583759.390777:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789583759.390782:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583759.390803:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391352:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391364:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391371:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391379:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391385:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.391390:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391399:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391422:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:2.0:1789583759.391426:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.391431:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391438:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e360d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391454:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.391461:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392096:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392103:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.392107:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392114:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392126:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b6583d4900) 00010000:00010000:2.0:1789583759.392129:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.392132:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392138:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392200:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6547 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392228:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6547 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.392235:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.392237:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583759.392240:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1400, rc 0) 00000100:00100000:2.0:1789583759.392337:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10561:x1876514313391744:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2102us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.392359:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 108 00000100:00100000:1.0:1789583759.397335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583759.399577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.399732:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313392128 00000100:00100000:2.0:1789583759.399747:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313392128 00000100:00100000:2.0:1789583759.399838:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 109 00000100:00100000:2.0:1789583759.399852:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10561:x1876514313392128:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583759.399882:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1789583759.399889:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313391872 00000100:00100000:1.0:1789583759.399896:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313391872 00010000:00010000:2.0:1789583759.399913:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3622 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec654e expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.399958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789583759.399966:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:2358:x1876514313391872:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583759.399989:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583759.400016:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e361b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6547 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.400035:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583759.400041:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583759.400061:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.400079:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.400090:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.400124:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+56:2358:x1876514313391872:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 157us (2803us total) trans 0 rc 0/0 00010000:00010000:2.0:1789583759.400134:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 56 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.400135:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00010000:00010000:2.0:1789583759.400156:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 55 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.400172:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332278144:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583759.400246:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583759.403137:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332278144:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583759.403396:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.405216:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.405335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313392256 00000100:00100000:3.0:1789583759.405348:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313392256 00010000:00010000:3.0:1789583759.405420:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 56 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583759.405467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789583759.405480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+56:2358:x1876514313392256:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583759.405499:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583759.405507:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 56 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.405523:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 56 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.405575:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e35f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6539 expref: 56 pid: 5849 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.405594:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583759.405600:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.405611:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.405620:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.405654:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583759.405730:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+55:2358:x1876514313392256:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 251us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.405738:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00010000:00010000:2.0:1789583759.405954:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.405964:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583759.405987:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789583759.406183:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3622 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 56 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.406205:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 55 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.406213:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.406216:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789583759.406219:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583759.406281:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10561:x1876514313392128:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 6432us (6717us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789583759.406288:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 109 00000100:00100000:1.0:1789583759.411159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.413886:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313392512 00000100:00100000:0.0:1789583759.413905:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313392512 00000100:00100000:0.0:1789583759.414005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:0.0:1789583759.414018:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10561:x1876514313392512:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:0.0:1789583759.414041:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583759.414074:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6524 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.414098:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583759.414104:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583759.414182:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10561:x1876514313392512:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 167us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.414189:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789583759.424327:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.424636:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313392640 00000100:00100000:2.0:1789583759.424650:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313392640 00000100:00100000:2.0:1789583759.424762:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 110 00000100:00100000:2.0:1789583759.424775:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10561:x1876514313392640:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:2.0:1789583759.424960:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.424995:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.425009:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583759.425288:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789583759.425412:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10561:x1876514313392640:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 630us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.425422:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 110 00000100:00100000:1.0:1789583759.430496:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.430692:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313392768 00000100:00100000:3.0:1789583759.430707:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313392768 00000100:00100000:3.0:1789583759.430785:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 111 00000100:00100000:3.0:1789583759.430795:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+54:10561:x1876514313392768:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583759.430853:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.430875:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6555 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.430942:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.430969:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.430988:0:5850:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.431012:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.431026:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583759.431030:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583759.431034:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 55 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.431040:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03400, rc 0) 00000100:00100000:3.0:1789583759.431098:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10561:x1876514313392768:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 304us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.431105:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 111 00000040:00080000:1.0:1789583759.783183:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583759.783195:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583759.783266:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789583759.783274:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789583759.783439:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c2f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332278272:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789583759.783580:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a3556c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583759.786335:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.786637:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313392896 00000100:00100000:0.0:1789583759.786649:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313392896 00000100:00100000:0.0:1789583759.786842:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 112 00000100:00100000:0.0:1789583759.786855:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313392896:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789583759.786926:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789583759.787081:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313392896:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 228us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.787089:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 112 00000100:00100000:2.0:1789583759.788183:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c2f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332278272:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789583759.790363:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.790519:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313393024 00000100:00100000:2.0:1789583759.790532:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313393024 00000100:00100000:2.0:1789583759.790605:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:2.0:1789583759.790617:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10562:x1876514313393024:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789583759.790724:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.790745:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.790759:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796616:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796640:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796673:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796706:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796716:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796722:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583759.796769:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789583759.796772:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583759.796784:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796795:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796801:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796822:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796828:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.796831:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796839:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796858:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:2.0:1789583759.796862:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.796866:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796873:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3645 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796890:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796895:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796901:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796905:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.796908:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796914:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796921:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff88b6583d4900) 00010000:00010000:2.0:1789583759.796923:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.796925:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796931:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e364c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796958:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796964:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796970:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796975:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583759.796978:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796984:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.796991:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583759.796994:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583759.796997:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.797002:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.797092:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10562:x1876514313393024:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 6474us (6739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.797101:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 113 00000100:00100000:3.0:1789583759.800455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583759.800574:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313393280 00000100:00100000:1.0:1789583759.800588:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313393280 00000100:00100000:1.0:1789583759.800786:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:1.0:1789583759.800801:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+55:10562:x1876514313393280:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583759.800886:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583759.800914:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e365a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec655c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801054:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801072:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801086:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583759.801100:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789583759.801229:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801237:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801245:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801251:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583759.801255:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801264:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801278:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583759.801288:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789583759.801295:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801301:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801363:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e365a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec655c expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801375:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:1.0:1789583759.801377:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583759.801380:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e365a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec655c expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.801391:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb600, rc 0) 00000100:00100000:1.0:1789583759.801480:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313393280:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 683us (1038us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789583759.801487:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 114 00000100:00100000:1.0:1789583759.807200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.811846:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313393408 00000100:00100000:0.0:1789583759.811871:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313393408 00000100:00100000:1.0:1789583759.812080:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:1.0:1789583759.812094:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313393408:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789583759.812140:0:8280:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789583759.812334:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313393408:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 242us (5147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583759.812342:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:0.0:1789583759.822532:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.822627:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313393664 00000100:00100000:2.0:1789583759.822640:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313393664 00000100:00100000:1.0:1789583759.822920:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:1.0:1789583759.822937:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313393664:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583759.822982:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583759.822985:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789583759.823015:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e35ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6540 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.823034:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583759.823039:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583759.823052:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e366f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6563 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789583759.824016:0:5850:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789583759.824316:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.824335:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.824349:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.824431:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e366f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6563 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.824453:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6563 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.824461:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b645246d00) 00010000:00010000:1.0:1789583759.824464:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583759.824479:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb200, rc 0) 00000100:00100000:1.0:1789583759.824566:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10562:x1876514313393664:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1635us (2049us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789583759.824754:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:3.0:1789583759.829564:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583759.830145:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313393920 00000100:00100000:1.0:1789583759.830160:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313393920 00000100:00100000:1.0:1789583759.830242:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:1.0:1789583759.830255:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10562:x1876514313393920:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789583759.830362:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583759.830395:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6563 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.830431:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b645246d00) 00010000:00010000:1.0:1789583759.830446:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583759.830474:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.830493:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.830506:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.831930:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.831953:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.831965:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832058:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832065:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832072:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832077:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfae00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583759.832081:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832089:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832100:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583759.832103:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583759.832108:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832114:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3684 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832127:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832132:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832138:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832148:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583759.832151:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832158:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832165:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x46062ed4 (ffff88b645246400) 00010000:00010000:1.0:1789583759.832167:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583759.832170:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.832176:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e368b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x46062ed4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.832295:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313393920:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 2027us (2732us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583759.832306:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:2.0:1789583759.839738:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.839924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313394048 00000100:00100000:3.0:1789583759.839937:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313394048 00000100:00100000:3.0:1789583759.840014:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789583759.840027:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+56:10562:x1876514313394048:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583759.840056:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.840088:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3692 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec656a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.840149:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.840166:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.840182:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.840314:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e3692 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.840339:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.840349:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583759.840353:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789583759.840357:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03600, rc 0) 00000100:00100000:3.0:1789583759.840447:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10562:x1876514313394048:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 423us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.840455:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:0.0:1789583759.847276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.847466:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313394304 00000100:00100000:2.0:1789583759.847479:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313394304 00000100:00100000:2.0:1789583759.847547:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:2.0:1789583759.847557:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+57:10562:x1876514313394304:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789583759.847669:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.847692:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.847708:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583759.848345:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789583759.848360:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316832553494ns, next at 317832550488ns, rc = 0 00000004:00010000:2.0:1789583759.848492:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ce50ca4 reply state 0000000079db7340 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.848504:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583759.849863:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+59:10562:x1876514313394304:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 2293us (2589us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789583759.849878:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 119 00010000:00010000:1.0:1789583759.859890:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.859911:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.859921:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.859928:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583759.859934:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.859964:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.859985:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:1.0:1789583759.859989:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789583759.859994:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.860002:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e36a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583759.863941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.864341:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313394432 00000100:00100000:3.0:1789583759.864356:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313394432 00000100:00100000:3.0:1789583759.864449:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:3.0:1789583759.864466:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+58:10562:x1876514313394432:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583759.864499:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.864527:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6571 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.864646:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.864666:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.864689:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583759.864693:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583759.864698:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a02a00, rc 0) 00000100:00100000:3.0:1789583759.864789:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+59:10562:x1876514313394432:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 328us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.864799:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:2.0:1789583759.870956:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583759.871413:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313394560 00000100:00100000:1.0:1789583759.871428:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313394560 00000100:00100000:1.0:1789583759.871583:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:1.0:1789583759.871596:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313394560:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789583759.872741:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2359:x1876514313394560:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 473us (1124us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789583759.872758:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:3.0:1789583759.875439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.875521:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313394816 00000100:00100000:0.0:1789583759.875535:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313394816 00000100:00100000:0.0:1789583759.875619:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:0.0:1789583759.875631:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+59:10562:x1876514313394816:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789583759.876012:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+60:10562:x1876514313394816:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 382us (587us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789583759.876022:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:2.0:1789583759.882791:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583759.883015:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395072 00000100:00100000:1.0:1789583759.883027:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395072 00000100:00100000:1.0:1789583759.883117:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:1.0:1789583759.883131:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+60:10562:x1876514313395072:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789583759.883321:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+60:10562:x1876514313395072:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 192us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583759.883330:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:2.0:1789583759.886442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.886718:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395200 00000100:00100000:3.0:1789583759.886732:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395200 00000100:00100000:3.0:1789583759.886999:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:3.0:1789583759.887013:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+60:10562:x1876514313395200:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583759.887042:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583759.887687:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e36ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6578 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.888487:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e36b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.888508:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e36b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.888535:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e36b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583759.888581:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583759.888604:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e36b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.889007:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03c00/0x6d3e73d72c6e36ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6578 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.889034:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e36b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6578 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583759.889043:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583759.889046:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789583759.889050:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b645a03e00, rc 0) 00000100:00100000:3.0:1789583759.889776:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+61:10562:x1876514313395200:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 2760us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.889787:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 122 00000100:00100000:3.0:1789583759.893664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583759.896507:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395328 00000100:00100000:1.0:1789583759.896551:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395328 00000100:00100000:1.0:1789583759.896637:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:1.0:1789583759.896651:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313395328:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583759.896673:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583759.896701:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec657f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583759.896738:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaae18f, blocks: 0x1 00010000:00010000:1.0:1789583759.896766:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=316s v=(0 0) 00010000:00010000:1.0:1789583759.896771:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583759.896782:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 10 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.898330:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 10 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583759.898367:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583759.898482:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2358:x1876514313395328:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1830us (4829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583759.898491:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00010000:00010000:0.0:1789583759.911538:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583759.911690:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332278400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583759.911801:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583759.912297:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332278400 00000100:00100000:0.0:1789583759.912308:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332278400 00000100:00100000:0.0:1789583759.912386:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789583759.912409:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332278400:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789583759.912613:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583759.912704:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.912753:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332278912:0@lo:400:kworker.0 00000100:00100000:3.0:1789583759.912755:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332278656:0@lo:400:kworker.0 00000100:00100000:2.0:1789583759.912835:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583759.912864:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395584 00000100:00100000:3.0:1789583759.912869:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395584 00000100:00100000:2.0:1789583759.912884:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789583759.912902:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332278912 00000100:00100000:2.0:1789583759.912904:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332278528:0@lo:400:kworker.0 00000100:00100000:3.0:1789583759.912915:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332278912 00000100:00080000:3.0:1789583759.912935:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583759.912946:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583759.912963:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789583759.912972:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332278912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583759.912984:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332279040:0@lo:400:kworker.0 00000100:00100000:2.0:1789583759.913017:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583759.913048:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332278912:12345-0@lo:400:kworker.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.913057:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789583759.913064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332278912:0@lo:400:kworker.0 00000100:00100000:3.0:1789583759.913319:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:3.0:1789583759.913329:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+61:10562:x1876514313395584:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00002000:00000024:0.0:1789583759.913349:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583759.913439:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+61:10562:x1876514313395584:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 112us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.913448:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 123 00000100:00100000:1.0:1789583759.913617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332278528 00000100:00100000:1.0:1789583759.913622:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332278528 00000100:00100000:1.0:1789583759.913657:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789583759.913664:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332278528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583759.913986:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332278400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583759.914023:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583759.914192:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332278400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1795us (2390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.914201:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789583759.914239:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332279040 00000100:00100000:0.0:1789583759.914244:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332279040 00000100:00100000:0.0:1789583759.914275:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789583759.914283:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332279040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583759.914347:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332279040:12345-0@lo:400:kworker.0 Request processed in 64us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.914353:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789583759.914419:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332278784:0@lo:400:kworker.0 00000100:00100000:0.0:1789583759.914452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583759.914500:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332278656 00000100:00100000:0.0:1789583759.914504:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332278656 00000100:00100000:0.0:1789583759.914527:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332278784 00000100:00100000:0.0:1789583759.914529:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332278784 00000100:00080000:0.0:1789583759.914549:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583759.914568:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789583759.914576:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332278656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583759.914609:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332278656:12345-0@lo:400:kworker.0 Request processed in 35us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.914615:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789583759.914628:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789583759.914634:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332278784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583759.914666:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332278784:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.914671:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789583759.914698:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332278784:0@lo:400:kworker.0 00000100:00100000:1.0:1789583759.919637:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332278528:12345-0@lo:400:kworker.0 Request processed in 5958us (6675us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583759.919643:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332278528:0@lo:400:kworker.0 00000100:00100000:3.0:1789583759.919673:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332279040:0@lo:400:kworker.0 00000100:00100000:1.0:1789583759.919681:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789583759.919950:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332278656:0@lo:400:kworker.0 00000100:00100000:2.0:1789583759.928595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.928711:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395712 00000100:00100000:0.0:1789583759.928724:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395712 00000100:00100000:0.0:1789583759.928802:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789583759.928869:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674d5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+10:10562:x1876514313395712:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789583759.928893:0:9665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583759.928920:0:9665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6586 expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.928963:0:9665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 11 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.928991:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583759.928996:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583759.929003:0:9665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 11 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.929049:0:9665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 11 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.929066:0:9665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 11 pid: 6702 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583759.929083:0:9665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9665:1876514332279168:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583759.929718:0:9665:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583759.936764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583759.936986:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395840 00000100:00100000:2.0:1789583759.936997:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395840 00000100:00100000:0.0:1789583759.937015:0:9665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9665:1876514332279168:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583759.937055:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 12 pid: 6702 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.937060:0:9665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 12 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583759.937106:0:9665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cbc00, rc 0) 00000100:00100000:0.0:1789583759.937197:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674d5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+12:10562:x1876514313395712:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 8342us (8617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583759.937207:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:2.0:1789583759.937515:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:2.0:1789583759.937527:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+11:2358:x1876514313395840:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583759.937545:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583759.937575:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 11 pid: 6702 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.937592:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 11 pid: 6702 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.937620:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008181cfb0/0x6d3e73d72c6e36bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec657f expref: 11 pid: 6702 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.937663:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583759.937668:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583759.937678:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 10 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.937691:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 10 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583759.937733:0:8527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 10 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583759.937753:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8527:1876514332279296:192.168.203.46@tcp:105: 00000100:00100000:2.0:1789583759.939028:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583759.944703:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8527:1876514332279296:192.168.203.46@tcp:105: 00010000:00010000:2.0:1789583759.944738:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583759.944902:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2358:x1876514313395840:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 7375us (8151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583759.944915:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:1.0:1789583759.954464:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583759.954554:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313395968 00000100:00100000:0.0:1789583759.954567:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313395968 00002000:00100000:0.0:1789583759.954635:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88b674c2d180 x1876514313395968/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:475/0 lens 504/0 e 0 to 0 dl 1789583770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583759.954666:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b674c2d180 with x1876514313395968 ext(0->12) 00002000:00010000:0.0:1789583759.954674:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b674c2d180 00000100:00100000:0.0:1789583759.954764:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789583759.954775:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2359:x1876514313395968:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789583759.957867:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+12:2359:x1876514313395968:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 3077us (3403us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789583759.957884:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00002000:00100000:0.0:1789583759.957900:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff88b674c2d180 x1876514313395968/t4294967308(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:475/0 lens 504/448 e 0 to 0 dl 1789583770 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583759.957913:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b674c2d180 with x1876514313395968 ext(0->12) 00002000:00010000:0.0:1789583759.957921:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b674c2d180 00000100:00100000:0.0:1789583759.962264:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583759.962919:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313396096 00000100:00100000:3.0:1789583759.962933:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313396096 00000100:00100000:3.0:1789583759.963106:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 124 00000100:00100000:3.0:1789583759.963119:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+61:10562:x1876514313396096:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789583760.036481:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1789583760.036501:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1789583760.037455:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332279424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789583760.037526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583760.037666:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332279424 00000100:00100000:1.0:1789583760.037681:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332279424 00000100:00100000:1.0:1789583760.037759:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789583760.037772:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332279424:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789583760.037867:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1789583760.038145:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789583760.038193:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b6618d09c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789583760.038198:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b64a65ab00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b64447f0c0 00000020:00080000:3.0:1789583760.038213:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b64a65af00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b541926000 00000020:00080000:3.0:1789583760.038237:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b650f943c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789583760.038240:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b64a65a300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b650f94e40 00000020:00080000:3.0:1789583760.038243:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b64a65a600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b6752ba000 00000020:00080000:3.0:1789583760.038252:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789583760.038263:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789583760.038450:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00002000:00080000:1.0:1789583760.038594:0:6705:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1789583760.038644:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aaae18e, atime: 0x0, ctime: 0x6aaae18e, blocks: 0x1 00010000:00010000:1.0:1789583760.038654:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.038676:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1789583760.038681:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583760.038689:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.038708:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.038719:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.038728:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.038758:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789583760.038893:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10562:x1876514313396096:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 75436us (76302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583760.038907:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 124 00010000:00010000:3.0:1789583760.038936:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583760.038944:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.038956:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583760.038970:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.038981:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039000:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039007:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000934db0e5/0x6d3e73d72c6e36ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039047:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583760.039050:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583760.039052:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583760.039079:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332279552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789583760.039126:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583760.039193:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332279552 00000100:00100000:3.0:1789583760.039201:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332279552 00000100:00100000:3.0:1789583760.039242:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789583760.039252:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332279552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789583760.039278:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:3.0:1789583760.039303:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039319:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039327:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789583760.039332:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583760.039337:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039369:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.039387:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 11 pid: 6702 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583760.039429:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1876514332279680:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583760.039482:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583760.040061:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332279424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2286us (2528us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789583760.040076:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1789583760.040107:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b674c7d180/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789583760.040117:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332279424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789583760.041020:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789583760.041043:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332279808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789583760.041226:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583760.041285:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332279808 00000100:00100000:0.0:1789583760.041295:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332279808 00000100:00100000:0.0:1789583760.041350:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789583760.041360:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876514332279808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789583760.041537:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789583760.041542:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789583759 00002000:00010000:0.0:1789583760.041544:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789583760.041630:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789583759 -> 1789583759 00002000:00010000:0.0:1789583760.041632:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789583760.041709:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1876514332279808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 350us (483us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789583760.041717:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:1.0:1789583760.042181:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b674c79f80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789583760.042189:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332279808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789583760.042741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583760.042802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583760.042901:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313396352 00000100:00100000:2.0:1789583760.042907:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313396352 00010000:00010000:2.0:1789583760.042948:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 12 pid: 6702 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583760.042983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:2.0:1789583760.043001:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+12:2358:x1876514313396352:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583760.043013:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583760.043019:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 12 pid: 6702 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.043032:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 12 pid: 6702 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.043063:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789583760.043068:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789583760.043074:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.043083:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.043100:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583760.043138:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+12:2358:x1876514313396352:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 139us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583760.043144:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00080000:3.0:1789583760.043263:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583760.043671:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313396224 00000100:00100000:1.0:1789583760.043678:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313396224 00010000:00010000:0.0:1789583760.043795:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e348c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64e5 expref: 12 pid: 6702 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.043832:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1876514332279680:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583760.043876:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.043894:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.043903:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.043913:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.043920:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.043945:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789583760.044506:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3306:x1876514332279552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5253us (5377us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789583760.044521:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789583760.044546:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:0.0:1789583760.044554:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+11:2359:x1876514313396224:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789583760.044761:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583760.044769:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.044778:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a03c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583760.044782:0:7652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.044799:0:7652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.044839:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.044847:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0003c47/0x6d3e73d72c6e36d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.044864:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583760.044866:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583760.044868:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789583760.045124:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b674c78000/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789583760.045131:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332279552:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1789583760.089695:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789583760.089714:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1789583760.090164:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313396224:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 45455us (47271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583760.090175:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:3.0:1789583760.099473:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583760.099673:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313396608 00000100:00100000:0.0:1789583760.099685:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313396608 00000100:00100000:0.0:1789583760.099773:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 125 00000100:00080000:3.0:1789583760.099780:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583760.099786:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10562:x1876514313396608:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789583760.099872:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583760.099903:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03e00/0x6d3e73d72c6e36b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6578 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.099927:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:0.0:1789583760.099933:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583760.099965:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.099988:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.099998:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789583760.100246:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b96163c4 reply state 000000004c716595 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.100270:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789583760.100361:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+16:10562:x1876514313396608:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 579us (897us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789583760.100499:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 125 00010000:00010000:0.0:1789583760.104213:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.104232:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.104240:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.104249:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583760.104255:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.104263:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583760.104281:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:0.0:1789583760.104287:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:0.0:1789583760.104293:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583760.104299:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.104306:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583760.105495:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313396736 00000100:00100000:2.0:1789583760.105509:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313396736 00000100:00100000:2.0:1789583760.105580:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:2.0:1789583760.105595:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313396736:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789583760.108858:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789583760.108868:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789583759 -> 1789583758 00002000:00010000:2.0:1789583760.108871:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789583758 00002000:00010000:2.0:1789583760.108873:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789583759 -> 1789583758 00002000:00010000:2.0:1789583760.108875:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789583760.108956:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313396736:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 3361us (4686us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789583760.108967:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:2.0:1789583760.115653:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.116390:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313396992 00000100:00100000:1.0:1789583760.116416:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313396992 00000100:00100000:1.0:1789583760.116496:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:1.0:1789583760.116508:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+15:10562:x1876514313396992:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789583760.116580:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.116596:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.116605:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.116641:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.116655:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 15 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.116690:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332279936:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583760.116779:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a355600 going to sleep for 11 seconds 00000100:00100000:3.0:1789583760.121237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.121436:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332279936:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583760.121470:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.122681:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313397120 00000100:00100000:0.0:1789583760.122696:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313397120 00010000:00010000:0.0:1789583760.122760:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.122852:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:0.0:1789583760.122863:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+16:2358:x1876514313397120:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583760.122878:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583760.122886:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.122899:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.122921:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03600/0x6d3e73d72c6e3699 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec656a expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.122942:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:0.0:1789583760.122948:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.122959:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.122967:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.122994:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583760.123026:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.123056:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+15:2358:x1876514313397120:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 194us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583760.123064:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00010000:00010000:1.0:1789583760.123252:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123281:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123288:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123295:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123309:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583760.123313:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123320:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123329:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:1.0:1789583760.123339:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789583760.123344:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.123350:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e36df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.123408:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+14:10562:x1876514313396992:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 6890us (7756us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789583760.123418:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 126 00000100:00100000:3.0:1789583760.127899:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.128160:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313397248 00000100:00100000:1.0:1789583760.128174:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313397248 00000100:00100000:1.0:1789583760.128264:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:1.0:1789583760.128277:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313397248:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789583760.128335:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.128361:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 7 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.128372:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789583760.128378:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789583760.128383:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.128438:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 7 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.128476:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 7 pid: 9665 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.128495:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332280064:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583760.128604:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a355600 going to sleep for 11 seconds 00000100:00100000:2.0:1789583760.131200:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583760.131373:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313397376 00000100:00100000:0.0:1789583760.131384:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313397376 00010000:00010000:0.0:1789583760.131450:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 8 pid: 9665 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.131500:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789583760.131512:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313397376:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583760.131533:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583760.131563:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 8 pid: 9665 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.131579:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 8 pid: 9665 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.131612:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583760.131616:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583760.131623:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.131634:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.131660:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583760.131740:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313397376:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 230us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583760.131749:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00010000:00010000:1.0:1789583760.132550:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfeb3eae/0x6d3e73d72c6e36c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6586 expref: 7 pid: 9665 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.132572:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332280064:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583760.132603:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132614:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132622:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132656:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132665:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132698:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132706:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583760.132711:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132722:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132740:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.132748:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0e32961/0x6d3e73d72c6e36e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.133798:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313397248:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 5515us (5906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583760.133836:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789583760.136567:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583760.137016:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313397632 00000100:00100000:0.0:1789583760.137048:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313397632 00000100:00100000:0.0:1789583760.137126:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 127 00000100:00100000:0.0:1789583760.137139:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:10562:x1876514313397632:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789583760.137270:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137292:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137307:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137586:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137600:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137610:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137654:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.137671:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 15 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.137688:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332280192:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583760.137867:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583760.142466:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332280192:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583760.142524:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583760.144796:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583760.145084:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313397760 00000100:00100000:3.0:1789583760.145097:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313397760 00010000:00010000:3.0:1789583760.145147:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583760.145227:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789583760.145239:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+16:2359:x1876514313397760:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583760.145258:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583760.145266:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.145311:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.145337:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02a00/0x6d3e73d72c6e36a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6571 expref: 16 pid: 5848 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.145357:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:3.0:1789583760.145363:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.145374:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.145383:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583760.145430:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583760.145497:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.145508:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583760.145510:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+15:2359:x1876514313397760:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 271us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583760.145527:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000001:00080000:1.0:1789583760.145778:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789583760.146001:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789583760.146051:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789583760.146149:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332280320:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789583760.146221:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583760.146337:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a355a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583760.146346:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332280320 00000100:00100000:0.0:1789583760.146356:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332280320 00000100:00100000:0.0:1789583760.146450:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789583760.146461:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876514332280320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789583760.146562:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876514332280320:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583760.146569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789583760.146652:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789583760.146659:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1789583760.146679:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b674c79f80, transno 4294967309 00000004:00080000:2.0:1789583760.146699:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b674c78000, transno 4294967310 00000100:00100000:2.0:1789583760.146707:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c2ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332280320:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789583760.147222:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1789583760.147292:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332280448:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789583760.147334:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583760.148228:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789583760.148271:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332280448 00000100:00100000:1.0:1789583760.148281:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332280448 00000100:00100000:1.0:1789583760.148330:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789583760.148340:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876514332280448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789583760.148641:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1876514332280448:12345-0@lo:1000:mdt00_002.0 Request processed in 301us (1304us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789583760.148649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583760.148787:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332280448:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789583760.148966:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.148978:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.148986:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149126:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752ca200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583760.149132:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149141:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149160:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b64336a700) 00010000:00010000:2.0:1789583760.149176:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583760.149183:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149190:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e36f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149231:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149237:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149244:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149249:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583760.149252:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149258:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149267:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583760.149269:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583760.149277:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149291:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149301:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583760.149348:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583760.149364:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332280576:192.168.203.46@tcp:105: 00000100:00100000:2.0:1789583760.149495:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789583760.153778:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332280576:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789583760.153845:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583760.154013:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:1.0:1789583760.154076:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3637 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154120:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154139:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154152:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154165:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154192:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154199:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154205:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583760.154336:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154344:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154358:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583760.154361:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583760.154366:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154372:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e36fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154386:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154393:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154409:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154415:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583760.154427:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154434:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154443:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583760.154445:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789583760.154448:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.154455:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e36ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.155327:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+18:10562:x1876514313397632:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 18182us (18765us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789583760.155342:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 127 00000020:00080000:1.0:1789583760.155350:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789583760.155410:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313397888 00000100:00100000:3.0:1789583760.155424:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313397888 00000100:00100000:3.0:1789583760.155666:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789583760.155690:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+18:10561:x1876514313397888:12345-192.168.203.46@tcp:49:lfs.0 00000100:00100000:3.0:1789583760.155846:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+18:10561:x1876514313397888:12345-192.168.203.46@tcp:49:lfs.0 Request processed in 159us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583760.155855:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000040:00080000:2.0:1789583760.156831:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583760.156839:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583760.159021:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789583760.159042:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789583760.159102:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.159146:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313398144 00000100:00100000:1.0:1789583760.159158:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313398144 00000100:00100000:3.0:1789583760.159203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.159225:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:3.0:1789583760.159241:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313398400 00000100:00100000:1.0:1789583760.159245:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+18:10562:x1876514313398144:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789583760.159248:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313398400 00000100:00100000:3.0:1789583760.159289:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:3.0:1789583760.159299:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+19:10561:x1876514313398400:12345-192.168.203.46@tcp:58:lfs.0 00000040:00080000:3.0:1789583760.159860:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789583760.159970:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+20:10561:x1876514313398400:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 670us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583760.159979:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 128 00000004:00080000:1.0:1789583760.160689:0:11497:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789583760.161067:0:11497:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789583760.161148:0:11497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.161168:0:11497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.161181:0:11497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.161200:0:11497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.161206:0:11497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.161212:0:11497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.161233:0:11497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583760.161298:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583760.161309:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.161317:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583760.161323:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.161333:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.161348:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff88b645246400) 00010000:00010000:0.0:1789583760.161352:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789583760.161360:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.161361:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+20:10562:x1876514313398144:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 2117us (2259us total) trans 4294967408 rc 0/0 00010000:00010000:0.0:1789583760.161377:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3702 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11497 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583760.161381:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000020:00080000:1.0:1789583760.161389:0:11497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789583760.161418:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583760.161429:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583760.161431:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583760.195168:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.195468:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313398528 00000100:00100000:1.0:1789583760.195482:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313398528 00000100:00100000:1.0:1789583760.195564:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:0.0:1789583760.195669:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+20:10564:x1876514313398528:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583760.195704:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583760.195742:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e3709 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec658d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.195845:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.195863:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.195876:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.195894:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.195902:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.195909:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.196211:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.196223:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 21 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.196233:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.196284:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 21 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.196301:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 21 pid: 8280 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.196319:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332280704:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583760.196439:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583760.201184:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583760.201185:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332280704:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583760.201221:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583760.201649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313398784 00000100:00100000:3.0:1789583760.201659:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313398784 00000100:00100000:3.0:1789583760.201793:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:3.0:1789583760.201841:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+22:5597:x1876514313398784:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789583760.202448:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+23:5597:x1876514313398784:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 640us (1276us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789583760.202458:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:2.0:1789583760.206079:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583760.207585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313398912 00000100:00100000:0.0:1789583760.207605:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313398912 00010000:00010000:0.0:1789583760.207670:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 23 pid: 8280 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583760.207859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:0.0:1789583760.207871:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+23:2359:x1876514313398912:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583760.207890:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583760.207900:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 23 pid: 8280 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.207917:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 23 pid: 8280 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.207969:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3629 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec654e expref: 23 pid: 8280 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.207998:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583760.208006:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.208017:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.208027:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583760.208111:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583760.208182:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+22:2359:x1876514313398912:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 313us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583760.208192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00010000:00010000:1.0:1789583760.208428:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208438:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583760.208601:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789583760.208607:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583760.208634:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208650:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208675:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208682:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208689:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208696:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cac00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583760.208700:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208709:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208725:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:1.0:1789583760.208729:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583760.208734:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208740:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208754:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208760:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208766:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208778:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583760.208781:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208788:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208797:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff88b643e76b00) 00010000:00010000:1.0:1789583760.208800:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583760.208803:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.208842:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.209002:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e3709 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec658d expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.209020:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec658d expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583760.209028:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583760.209030:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583760.209033:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cba00, rc 0) 00000100:00100000:1.0:1789583760.209076:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10564:x1876514313398528:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 13500us (13925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583760.209084:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:3.0:1789583760.423540:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583760.423563:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332280832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583760.423630:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583760.423912:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332280832 00000100:00100000:2.0:1789583760.423920:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332280832 00000100:00100000:2.0:1789583760.423969:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789583760.423978:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876514332280832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583760.424082:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583760.424136:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876514332280832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583760.424143:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789583760.424250:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332280832:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789583760.897716:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789583760.897724:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789583760.897794:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789583760.897801:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789583760.936090:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583760.948925:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.948968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.949008:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.949036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.949060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583760.949085:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399168 00000100:00100000:1.0:1789583760.949093:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399168 00000100:00100000:1.0:1789583760.949139:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399552 00000100:00100000:1.0:1789583760.949143:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399552 00000100:00100000:1.0:1789583760.949174:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:1.0:1789583760.949183:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:2358:x1876514313399168:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583760.949254:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:2358:x1876514313399168:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583760.949262:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 128 00000100:00100000:1.0:1789583760.949345:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:1.0:1789583760.949357:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313399552:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583760.949398:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313399552:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 36us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583760.949405:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 129 00000100:00100000:1.0:1789583760.949425:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399424 00000100:00100000:1.0:1789583760.949429:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399424 00000100:00100000:1.0:1789583760.949453:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399296 00000100:00100000:1.0:1789583760.949456:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399296 00000100:00100000:1.0:1789583760.949479:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:1.0:1789583760.949486:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313399424:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583760.949512:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313399424:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583760.949530:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:1.0:1789583760.949542:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:1.0:1789583760.949560:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313399296:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583760.949588:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313399296:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 39us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583760.949594:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00080000:1.0:1789583760.949612:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583760.949617:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583760.950670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399040 00000100:00100000:0.0:1789583760.950679:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399040 00000100:00100000:0.0:1789583760.950725:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 285 00000100:00100000:0.0:1789583760.950735:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313399040:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583760.951273:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313399040:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 539us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583760.951282:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 285 00000040:00080000:2.0:1789583761.191323:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583761.191333:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583761.191417:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789583761.191424:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789583761.191554:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332280960:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789583761.191726:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba000 going to sleep for 11 seconds 00000100:00100000:1.0:1789583761.206640:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583761.206709:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399680 00000100:00100000:2.0:1789583761.206715:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c78000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332280960:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789583761.206718:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399680 00000100:00100000:3.0:1789583761.206782:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 130 00000100:00100000:3.0:1789583761.206793:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10576:x1876514313399680:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789583761.206869:0:8280:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789583761.206961:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10576:x1876514313399680:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 168us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583761.206969:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 130 00000100:00100000:1.0:1789583761.211036:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583761.211230:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313399936 00000100:00100000:2.0:1789583761.211240:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313399936 00000100:00100000:2.0:1789583761.211293:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:2.0:1789583761.211303:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+21:10576:x1876514313399936:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583761.211324:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583761.211345:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3725 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6594 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583761.211450:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e372c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583761.211465:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e372c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583761.211478:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e372c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583761.211489:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789583761.211600:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3725 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6594 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583761.211618:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e372c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6594 expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583761.211642:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583761.211645:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583761.211649:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0400, rc 0) 00000100:00100000:2.0:1789583761.211707:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+23:10576:x1876514313399936:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 404us (680us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789583761.211714:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 131 00000100:00100000:0.0:1789583761.232197:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583761.232231:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583761.232399:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313400320 00000100:00100000:3.0:1789583761.232401:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313400192 00000100:00100000:3.0:1789583761.232409:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313400192 00000100:00100000:1.0:1789583761.232409:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313400320 00000100:00100000:3.0:1789583761.232469:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 132 00000100:00100000:3.0:1789583761.232480:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+24:10576:x1876514313400192:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789583761.232502:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:1.0:1789583761.232510:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+24:2359:x1876514313400320:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583761.232520:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583761.232542:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e372c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6594 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.232548:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.232561:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.232749:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583761.232923:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583761.232938:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583761.232978:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583761.232985:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+24:2359:x1876514313400320:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 476us (753us total) trans 0 rc 0/0 00010000:00010000:3.0:1789583761.232986:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.232993:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583761.232993:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00010000:00010000:3.0:1789583761.232999:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583761.233003:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.233028:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.233040:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583761.233043:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789583761.233046:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583761.233052:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e373a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583761.233161:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+23:10576:x1876514313400192:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 683us (973us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789583761.233169:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 132 00000040:00080000:1.0:1789583761.233291:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583761.233295:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583761.233786:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789583761.233794:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789583761.235796:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583761.235872:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313400576 00000100:00100000:0.0:1789583761.235889:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313400576 00000100:00100000:0.0:1789583761.235939:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:0.0:1789583761.235949:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+23:10576:x1876514313400576:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789583761.236213:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+24:10576:x1876514313400576:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 265us (423us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789583761.236221:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00010000:00010000:2.0:1789583761.959623:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583762.668886:0:12173:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583762.668896:0:12173:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583762.668952:0:12173:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789583762.668957:0:12173:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789583762.825785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583762.825895:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313400832 00000100:00100000:3.0:1789583762.825904:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313400832 00000100:00100000:3.0:1789583762.825973:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:3.0:1789583762.825985:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+24:10596:x1876514313400832:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583762.826009:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583762.826031:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3741 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec659b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583762.826149:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e3748 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583762.826168:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e3748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583762.826180:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e3748 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583762.826203:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789583762.826340:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3741 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec659b expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583762.826360:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e3748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec659b expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583762.826368:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:3.0:1789583762.826371:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789583762.826385:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f400, rc 0) 00000100:00100000:3.0:1789583762.826447:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+26:10596:x1876514313400832:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 464us (671us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789583762.826454:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00080000:0.0:1789583762.826747:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583762.844306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583762.844575:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313400960 00000100:00100000:2.0:1789583762.844587:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313400960 00000100:00100000:2.0:1789583762.844648:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:2.0:1789583762.844659:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+26:10596:x1876514313400960:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:2.0:1789583762.844729:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844750:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844761:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844787:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844794:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844802:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844841:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583762.844846:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844854:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844867:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:2.0:1789583762.844870:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789583762.844875:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583762.844881:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583762.844952:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+26:10596:x1876514313400960:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 294us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583762.844960:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:3.0:1789583762.951062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583762.953138:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401088 00000100:00100000:1.0:1789583762.953152:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401088 00000100:00100000:1.0:1789583762.953249:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:1.0:1789583762.953261:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313401088:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:1.0:1789583762.953277:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583762.953298:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd6de73/0x6d3e73d72c6e375d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65a2 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583762.953325:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aaae18e, atime: 0x6aaae18e, ctime: 0x6aaae18e, blocks: 0xb 00010000:00010000:1.0:1789583762.953344:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=319s v=(0 0) 00010000:00010000:1.0:1789583762.953349:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583762.953359:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd6de73/0x6d3e73d72c6e375d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65a2 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583762.953388:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebd6de73/0x6d3e73d72c6e375d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65a2 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583762.953402:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfbe00, rc 0) 00000100:00100000:1.0:1789583762.953482:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313401088:12345-192.168.203.46@tcp:101:cat.0 Request processed in 223us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583762.953505:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00080000:0.0:1789583762.953627:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583762.959912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583762.960500:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401216 00000100:00100000:0.0:1789583762.960511:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401216 00002000:00100000:0.0:1789583762.960564:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88b674c78380 x1876514313401216/t0(0) o3->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:478/0 lens 488/0 e 0 to 0 dl 1789583773 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583762.960575:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b674c78380 with x1876514313401216 ext(0->4095) 00002000:00010000:0.0:1789583762.960581:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b674c78380 00000100:00100000:0.0:1789583762.960616:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:0.0:1789583762.960626:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313401216:12345-192.168.203.46@tcp:3:cat.0 00000100:00100000:0.0:1789583762.961013:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313401216:12345-192.168.203.46@tcp:3:cat.0 Request processed in 387us (1110us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789583762.961022:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00002000:00100000:0.0:1789583762.961029:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff88b674c78380 x1876514313401216/t0(0) o3->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:478/0 lens 488/4536 e 0 to 0 dl 1789583773 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583762.961036:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b674c78380 with x1876514313401216 ext(0->4095) 00002000:00010000:0.0:1789583762.961040:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b674c78380 00010000:00010000:0.0:1789583762.985871:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583764.007095:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789583764.070212:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789583764.070227:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789583764.070234:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1789583765.032092:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332281216:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032155:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.032200:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332281728:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032225:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.032255:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789583765.032261:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332281088:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032288:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.032308:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332281600:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032343:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.032380:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332281344:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032416:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.032438:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583765.032443:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332281472:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032465:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.032496:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281216 00000100:00100000:2.0:1789583765.032503:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281216 00000100:00100000:2.0:1789583765.032542:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281600 00000100:00100000:2.0:1789583765.032545:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281600 00000100:00100000:2.0:1789583765.032568:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281344 00000100:00100000:2.0:1789583765.032570:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281344 00000100:00100000:2.0:1789583765.032585:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789583765.032593:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332281216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032767:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332281216:12345-0@lo:400:kworker.0 Request processed in 172us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.032775:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789583765.032794:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789583765.032800:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332281600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032857:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332281600:12345-0@lo:400:kworker.0 Request processed in 57us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.032863:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789583765.032876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789583765.032882:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332281344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.032913:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332281344:12345-0@lo:400:kworker.0 Request processed in 31us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.032929:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789583765.032946:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281728 00000100:00100000:2.0:1789583765.032949:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281728 00000100:00100000:2.0:1789583765.032983:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281472 00000100:00100000:2.0:1789583765.032987:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281472 00000100:00100000:2.0:1789583765.033006:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789583765.033012:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332281728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033050:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332281728:12345-0@lo:400:kworker.0 Request processed in 38us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.033055:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789583765.033067:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789583765.033073:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332281472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033097:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332281472:12345-0@lo:400:kworker.0 Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.033102:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789583765.033118:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281088 00000100:00100000:2.0:1789583765.033121:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281088 00000100:00100000:2.0:1789583765.033143:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789583765.033148:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332281088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033172:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332281088:12345-0@lo:400:kworker.0 Request processed in 24us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.033177:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1789583765.033212:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789583765.033215:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789583765.033218:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583765.033222:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332281856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583765.033245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.033276:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332281472:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033287:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332281344:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033320:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281856 00000100:00100000:2.0:1789583765.033324:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281856 00000100:00100000:2.0:1789583765.033345:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789583765.033352:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332281856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583765.033385:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00010000:00010000:0.0:1789583765.033388:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583765.033420:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332281856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.033426:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789583765.033453:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332281856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583765.033474:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332281088:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033484:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675088700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332281600:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033493:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332281216:0@lo:400:kworker.0 00000100:00100000:2.0:1789583765.033500:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789583765.033504:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789583765.033518:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b674c7d180, transno 4294967304 00000100:00100000:2.0:1789583765.033526:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675089880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332281728:0@lo:400:kworker.0 00000001:00080000:3.0:1789583765.058193:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1789583765.058233:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b64566aa80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789583765.058238:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b648c5e800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b64566a840 00000020:00080000:3.0:1789583765.058242:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b648c5e700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b64904c000 00000001:00080000:3.0:1789583765.058253:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789583765.058265:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789583765.058275:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789583765.058454:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1789583765.544204:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332281984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583765.544285:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583765.544466:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332281984 00000100:00100000:2.0:1789583765.544474:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332281984 00000100:00100000:2.0:1789583765.544525:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789583765.544536:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332281984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583765.544569:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583765.544613:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332281984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583765.544620:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789583765.545231:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332281984:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789583765.602551:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1789583765.602651:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1789583766.054972:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583766.069446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583766.069585:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583766.069631:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583766.069682:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583766.069697:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401600 00000100:00100000:2.0:1789583766.069711:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401600 00000100:00100000:3.0:1789583766.069724:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583766.069797:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401856 00000100:00100000:2.0:1789583766.069863:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401728 00000100:00100000:1.0:1789583766.069864:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401472 00000100:00100000:3.0:1789583766.069867:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401856 00000100:00100000:2.0:1789583766.069870:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401728 00000100:00100000:1.0:1789583766.069872:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401472 00000100:00100000:2.0:1789583766.069919:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583766.069932:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313401600:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583766.069958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:2.0:1789583766.070022:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2361:x1876514313401600:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 82us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583766.070031:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583766.070051:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:2.0:1789583766.070059:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313401728:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583766.070084:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313401728:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583766.070090:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00080000:2.0:1789583766.070111:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583766.070116:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583766.070117:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583766.070607:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313401856:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583766.070608:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:1.0:1789583766.070627:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2361:x1876514313401472:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583766.070689:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2361:x1876514313401856:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 718us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583766.070696:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2361:x1876514313401472:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 70us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583766.070712:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 133 00000100:00100000:1.0:1789583766.070860:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 134 00000100:00100000:0.0:1789583766.074589:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401344 00000100:00100000:0.0:1789583766.074609:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401344 00000100:00100000:0.0:1789583766.074703:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 287 00000100:00100000:0.0:1789583766.074716:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313401344:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583766.074845:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313401344:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 131us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583766.074852:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 287 00000100:00100000:3.0:1789583766.734134:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583766.734455:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313401984 00000100:00100000:2.0:1789583766.734465:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313401984 00000100:00100000:2.0:1789583766.734524:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 135 00000100:00100000:2.0:1789583766.734534:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10241:x1876514313401984:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789583766.734655:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10241:x1876514313401984:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 Request processed in 122us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583766.734662:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 135 00000100:00100000:3.0:1789583766.737835:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583766.738631:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313402240 00000100:00100000:2.0:1789583766.738642:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313402240 00000100:00100000:2.0:1789583766.738701:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:2.0:1789583766.738736:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+13:10241:x1876514313402240:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789583766.739121:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+14:10241:x1876514313402240:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 387us (1487us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789583766.739128:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00010000:00010000:1.0:1789583767.080606:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583768.103712:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789583768.324884:0:12372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:36:06 (1789583766) 00000040:00080000:1.0:1789583768.423039:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583768.423047:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789583768.423585:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789583768.423593:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789583769.127348:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583769.559100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583769.559280:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313402496 00000100:00100000:1.0:1789583769.559289:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313402496 00000100:00100000:1.0:1789583769.559400:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:1.0:1789583769.559411:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+14:11306:x1876514313402496:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583769.559432:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583769.559466:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3764 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65a9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559532:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559544:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559570:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559597:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559605:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559612:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559882:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3779 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559891:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3779 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.559897:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3779 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583769.559906:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789583769.559993:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560001:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560007:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560014:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583769.560023:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560031:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560042:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88b6583d4100) 00010000:00010000:1.0:1789583769.560045:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583769.560049:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560055:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e376b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560066:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560071:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560076:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789583769.560274:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789583769.560311:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583769.560314:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560320:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560337:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88b645246e00) 00010000:00010000:1.0:1789583769.560340:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583769.560349:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560356:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3772 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560967:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3764 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65a9 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560983:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3779 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65a9 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583769.560990:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:1.0:1789583769.560992:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583769.560994:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb600, rc 0) 00000100:00100000:1.0:1789583769.561051:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+16:11306:x1876514313402496:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1643us (1961us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1789583769.561058:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 136 00000100:00100000:3.0:1789583769.565149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583769.566358:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313402624 00000100:00100000:0.0:1789583769.566370:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313402624 00000100:00100000:0.0:1789583769.566439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583769.566450:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+16:2360:x1876514313402624:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583769.566464:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583769.566487:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3779 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65a9 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583769.566525:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:0.0:1789583769.566531:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583769.566588:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+15:2360:x1876514313402624:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 140us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583769.566596:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583769.567469:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583769.567570:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313402752 00000100:00100000:3.0:1789583769.567577:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313402752 00000100:00100000:3.0:1789583769.567621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:3.0:1789583769.567630:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+15:11306:x1876514313402752:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789583769.567728:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+15:11306:x1876514313402752:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 99us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583769.567735:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 137 00000100:00100000:1.0:1789583770.151379:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332282112:0@lo:400:kworker.0 00000100:00100000:2.0:1789583770.151441:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332282240:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.151452:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583770.151497:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332282624:0@lo:400:kworker.0 00000100:00100000:2.0:1789583770.151500:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583770.151526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583770.151529:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332282752:0@lo:400:kworker.0 00000100:00100000:2.0:1789583770.151561:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583770.151575:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332282368:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.151600:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583770.151618:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583770.151623:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332282496:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.151639:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583770.151688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282112 00000100:00100000:1.0:1789583770.151695:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282112 00000100:00100000:1.0:1789583770.151748:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789583770.151756:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332282112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.151796:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3305:x1876514332282112:12345-0@lo:400:kworker.0 Request processed in 41us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.151802:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789583770.151860:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282240 00000100:00100000:1.0:1789583770.151864:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282240 00000100:00100000:1.0:1789583770.151885:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282624 00000100:00100000:1.0:1789583770.151887:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282624 00000100:00100000:1.0:1789583770.151909:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282368 00000100:00100000:1.0:1789583770.151912:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282368 00000100:00100000:1.0:1789583770.151930:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789583770.151936:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332282240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.151981:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332282240:12345-0@lo:400:kworker.0 Request processed in 46us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.151988:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789583770.152000:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789583770.152007:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332282624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152035:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332282624:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.152040:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789583770.152062:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789583770.152068:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332282368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152101:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332282368:12345-0@lo:400:kworker.0 Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.152115:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789583770.152137:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282752 00000100:00100000:1.0:1789583770.152141:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282752 00000100:00100000:1.0:1789583770.152167:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282496 00000100:00100000:1.0:1789583770.152170:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282496 00000100:00100000:1.0:1789583770.152194:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789583770.152201:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332282752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152232:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332282752:12345-0@lo:400:kworker.0 Request processed in 33us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.152238:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789583770.152247:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789583770.152252:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152272:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332282496:12345-0@lo:400:kworker.0 Request processed in 20us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.152277:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789583770.152304:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332282112:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675234700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332282624:0@lo:400:kworker.0 00000100:00080000:1.0:1789583770.152350:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583770.152355:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583770.152358:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789583770.152366:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583770.152377:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1789583770.152383:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1789583770.152399:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675235500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332282496:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152408:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675234e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332282368:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152454:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675235c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332282240:0@lo:400:kworker.0 00000100:00100000:1.0:1789583770.152462:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675237b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332282752:0@lo:400:kworker.0 00000100:00100000:3.0:1789583770.154156:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332282880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583770.154213:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583770.154356:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332282880 00000100:00100000:0.0:1789583770.154364:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332282880 00000100:00100000:0.0:1789583770.154410:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789583770.154420:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332282880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789583770.154451:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583770.154498:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332282880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583770.154505:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789583770.154737:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332282880:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1789583770.199223:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789583770.199241:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789583770.199317:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789583770.199341:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:0.0:1789583770.471154:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789583770.471163:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789583770.471198:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789583770.471205:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789583770.663027:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332283008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583770.663094:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583770.663134:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332283008 00000100:00100000:1.0:1789583770.663144:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332283008 00000100:00100000:1.0:1789583770.663197:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789583770.663205:0:6707:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789583770.663209:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332283008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789583770.663216:0:6707:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789583770.663244:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583770.663310:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332283008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583770.663328:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789583770.663682:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332283008:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789583771.176625:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583771.195270:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.195305:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313402880 00000100:00100000:1.0:1789583771.195323:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313402880 00000100:00100000:1.0:1789583771.195372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 289 00000100:00100000:1.0:1789583771.195382:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313402880:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583771.195445:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313402880:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.195453:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 289 00000100:00100000:1.0:1789583771.198472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.198515:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.198545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.198570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.198593:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403392 00000100:00100000:1.0:1789583771.198601:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403392 00000100:00100000:1.0:1789583771.198662:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403008 00000100:00100000:1.0:1789583771.198666:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403008 00000100:00100000:1.0:1789583771.198701:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:1.0:1789583771.198709:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2359:x1876514313403392:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583771.198771:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2359:x1876514313403392:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.198779:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:1.0:1789583771.198797:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 139 00000100:00100000:1.0:1789583771.198830:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2358:x1876514313403008:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583771.198857:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2358:x1876514313403008:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.198863:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 139 00000100:00100000:1.0:1789583771.198881:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403136 00000100:00100000:1.0:1789583771.198884:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403136 00000100:00100000:1.0:1789583771.198905:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403264 00000100:00100000:1.0:1789583771.198908:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403264 00000100:00100000:1.0:1789583771.198938:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:1.0:1789583771.198946:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313403136:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583771.198970:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313403136:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 25us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.198976:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:1.0:1789583771.198986:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:1.0:1789583771.198992:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313403264:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583771.199016:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313403264:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.199020:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00080000:1.0:1789583771.199035:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583771.199043:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583771.199046:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583771.268397:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.268526:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403520 00000100:00100000:2.0:1789583771.268536:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403520 00000100:00100000:2.0:1789583771.268594:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:2.0:1789583771.268605:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:11348:x1876514313403520:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583771.268635:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583771.268675:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65b0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.268736:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.268750:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.268770:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.268786:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.268793:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.268800:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269304:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269323:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269331:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269337:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583771.269341:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269349:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269361:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:2.0:1789583771.269364:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583771.269369:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269383:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e378e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269395:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269401:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269406:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269411:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583771.269414:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269419:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269427:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88b6583d4d00) 00010000:00010000:2.0:1789583771.269429:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583771.269432:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269438:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e3795 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269468:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3787 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65b0 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269488:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:2.0:1789583771.269490:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583771.269494:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65b0 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.269503:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583771.269599:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+13:11348:x1876514313403520:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 995us (1210us total) trans 0 rc 301/301 00000100:00100000:2.0:1789583771.269607:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 138 00000100:00100000:1.0:1789583771.280844:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.281022:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403776 00000100:00100000:3.0:1789583771.281037:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403776 00000100:00100000:3.0:1789583771.281156:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 139 00000100:00100000:3.0:1789583771.281177:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+13:11348:x1876514313403776:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:3.0:1789583771.281253:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583771.281287:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3113 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63f0 expref: 13 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.281321:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583771.281337:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583771.281869:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.281887:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.281899:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.282703:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.282721:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.282732:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583771.284356:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789583771.284375:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.284386:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.284395:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.284401:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583771.284406:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.284414:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.284431:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64336ab00) 00010000:00010000:3.0:1789583771.284434:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583771.284440:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.284447:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e379c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583771.284470:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e610ed7 reply state 0000000072b73adf transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583771.284479:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583771.284590:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:11348:x1876514313403776:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 3420us (3777us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789583771.284609:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 139 00010000:00010000:3.0:1789583771.287747:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.287768:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.287778:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.287784:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216e400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583771.287790:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.287798:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.287846:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88b64336a100) 00010000:00010000:3.0:1789583771.287851:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583771.287858:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.287866:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216e400/0x6d3e73d72c6e37a3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.373924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.374210:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313403904 00000100:00100000:2.0:1789583771.374230:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313403904 00000100:00100000:2.0:1789583771.374291:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:2.0:1789583771.374301:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+13:11356:x1876514313403904:12345-192.168.203.46@tcp:101:lctl.0 00010000:00010000:2.0:1789583771.374334:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583771.374357:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e37aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65b7 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.374423:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e37b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.374436:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e37b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.374448:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e37b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583771.374484:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789583771.374499:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583771.374521:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e37b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.374545:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e37aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65b7 expref: 15 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.374561:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e37b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65b7 expref: 14 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.374568:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:2.0:1789583771.374571:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583771.374574:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0800, rc 0) 00000100:00100000:2.0:1789583771.374635:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+14:11356:x1876514313403904:12345-192.168.203.46@tcp:101:lctl.0 Request processed in 336us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583771.374642:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 140 00000100:00100000:1.0:1789583771.417119:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583771.417239:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313404032 00000100:00100000:0.0:1789583771.417252:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313404032 00000100:00100000:0.0:1789583771.417334:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:0.0:1789583771.417346:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+14:11362:x1876514313404032:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583771.417371:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583771.417430:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e37b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65be expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.417514:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.417531:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.417545:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.417560:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.417568:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.417575:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.419413:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e37cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.419434:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e37cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.419515:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e37cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583771.419564:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789583771.419568:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583771.419588:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e37cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420208:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420218:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420225:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420232:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583771.420236:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420244:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420257:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:0.0:1789583771.420260:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583771.420264:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420270:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e37bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420287:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420293:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420299:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420324:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752caa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583771.420327:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420333:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420342:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88b643e76400) 00010000:00010000:0.0:1789583771.420344:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583771.420347:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420353:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e37c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420396:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e37b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65be expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420411:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e37cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65be expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.420418:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583771.420420:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789583771.420422:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca600, rc 0) 00000100:00100000:1.0:1789583771.422635:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+15:11362:x1876514313404032:12345-192.168.203.46@tcp:101:bash.0 Request processed in 5267us (5506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.422647:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 141 00000100:00100000:0.0:1789583771.429685:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.432849:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313404288 00000100:00100000:2.0:1789583771.432863:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313404288 00000100:00100000:2.0:1789583771.432938:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:2.0:1789583771.432950:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67baac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+15:11362:x1876514313404288:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583771.432970:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583771.432991:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e37d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65c5 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433120:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433135:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433163:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433220:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433228:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433235:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789583771.433776:0:8280:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789583771.433980:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433990:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.433998:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434030:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434037:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434043:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434050:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583771.434061:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434068:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434082:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:2.0:1789583771.434085:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583771.434089:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434096:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e37db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583771.434109:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b9bbc08 reply state 0000000099d3c527 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583771.434118:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789583771.434148:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e37d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 18 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434163:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 17 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.434170:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:2.0:1789583771.434172:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583771.434175:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0200, rc 0) 00000100:00100000:2.0:1789583771.434249:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67baac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11362:x1876514313404288:12345-192.168.203.46@tcp:101:bash.0 Request processed in 1302us (4573us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789583771.434257:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 142 00000100:00100000:2.0:1789583771.442939:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:0.0:1789583771.443025:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.443038:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.443059:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.443063:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313404416 00010000:00010000:0.0:1789583771.443066:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583771.443072:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.443074:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313404416 00010000:00010000:0.0:1789583771.443096:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.443111:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b6583d4900) 00010000:00010000:0.0:1789583771.443114:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583771.443119:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.443125:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e37e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.443205:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:1.0:1789583771.443216:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2358:x1876514313404416:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789583771.443234:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583771.443252:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65cc expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583771.443277:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583771.443296:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:1.0:1789583771.443300:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583771.443308:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.443335:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 6 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.443347:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfaa00, rc 0) 00000100:00100000:1.0:1789583771.443413:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313404416:12345-192.168.203.46@tcp:101:bash.0 Request processed in 199us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.443420:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:1.0:1789583771.446052:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.451923:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313404544 00000100:00100000:3.0:1789583771.451937:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313404544 00000100:00100000:3.0:1789583771.452018:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789583771.452028:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:11362:x1876514313404544:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789583771.452047:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583771.452078:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65d3 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.452258:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.452268:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583771.452273:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583771.452278:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.452323:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.452338:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583771.452352:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1876514332283136:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583771.452454:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b651a19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583771.461017:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1876514332283136:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583771.461076:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.461105:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216e400, rc 0) 00000100:00100000:3.0:1789583771.461211:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:11362:x1876514313404544:12345-192.168.203.46@tcp:101:bash.0 Request processed in 9183us (15166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583771.461242:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:2.0:1789583771.467489:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.469397:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313404672 00000100:00100000:1.0:1789583771.469536:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313404672 00010000:00010000:1.0:1789583771.469590:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.469638:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:1.0:1789583771.469648:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313404672:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583771.469665:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583771.469689:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.469705:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.469731:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e37f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65cc expref: 7 pid: 6702 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.469757:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583771.469762:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583771.469770:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.470529:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.470577:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.470593:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675235180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1876514332283264:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789583771.470686:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583771.474183:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675235180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5834:1876514332283264:192.168.203.46@tcp:105: 00010000:00010000:0.0:1789583771.474223:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583771.474358:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2358:x1876514313404672:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 4709us (6880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583771.474371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:0.0:1789583771.475201:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.475277:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313404928 00000100:00100000:1.0:1789583771.475289:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313404928 00000100:00100000:3.0:1789583771.475385:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:3.0:1789583771.475399:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+17:11362:x1876514313404928:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:3.0:1789583771.475883:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11362:x1876514313404928:12345-192.168.203.46@tcp:35:bash.0 Request processed in 485us (686us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789583771.475892:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:2.0:1789583771.534756:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.534904:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313405184 00000100:00100000:3.0:1789583771.534918:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313405184 00000100:00100000:3.0:1789583771.534997:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:3.0:1789583771.535009:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11372:x1876514313405184:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583771.535040:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583771.535067:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3805 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65da expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583771.535189:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789583771.535351:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3805 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65da expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.535368:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:3.0:1789583771.535371:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583771.535377:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3805 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65da expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.535396:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f600, rc 0) 00000100:00100000:3.0:1789583771.535474:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+19:11372:x1876514313405184:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 467us (731us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789583771.535500:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:1.0:1789583771.539525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.539727:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313405440 00000100:00100000:2.0:1789583771.539741:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313405440 00000100:00100000:2.0:1789583771.540015:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:2.0:1789583771.540032:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:11372:x1876514313405440:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583771.541393:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11372:x1876514313405440:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 1353us (1870us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789583771.541408:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:0.0:1789583771.624849:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.625346:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313405568 00000100:00100000:3.0:1789583771.625362:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313405568 00000100:00100000:3.0:1789583771.625480:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:3.0:1789583771.625492:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11378:x1876514313405568:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583771.625523:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583771.625550:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3813 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65e1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.625641:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e381a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.625659:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e381a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.625673:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e381a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583771.625717:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789583771.625721:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583771.625742:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e381a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.625772:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f600/0x6d3e73d72c6e3813 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65e1 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.625796:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e381a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65e1 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.625859:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:3.0:1789583771.625863:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583771.625868:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483800, rc 0) 00000100:00100000:3.0:1789583771.626152:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+21:11378:x1876514313405568:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 661us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583771.626160:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 144 00000100:00100000:3.0:1789583771.632557:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.632889:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313405824 00000100:00100000:1.0:1789583771.632903:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313405824 00000100:00100000:1.0:1789583771.633043:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 145 00000100:00100000:1.0:1789583771.633055:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+21:11378:x1876514313405824:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583771.633085:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583771.633114:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65e8 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.633248:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.633267:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.633282:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583771.633327:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789583771.633497:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65e8 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.633522:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65e8 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.633533:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:1.0:1789583771.633536:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583771.633541:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb400, rc 0) 00000100:00100000:1.0:1789583771.634171:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+23:11378:x1876514313405824:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1115us (1624us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789583771.634182:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 145 00000100:00100000:0.0:1789583771.640281:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583771.640421:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.640515:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406208 00000100:00100000:2.0:1789583771.640527:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406208 00000100:00100000:2.0:1789583771.640609:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789583771.640620:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+23:2361:x1876514313406208:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583771.640642:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583771.640672:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65e8 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.640695:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:2.0:1789583771.640702:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583771.640774:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+22:2361:x1876514313406208:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 156us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583771.640782:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:1.0:1789583771.641081:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406080 00000100:00100000:1.0:1789583771.641088:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406080 00000100:00100000:1.0:1789583771.641162:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:1.0:1789583771.641171:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+22:11378:x1876514313406080:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583771.641194:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583771.641214:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65ef expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.641343:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e383d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.641360:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e383d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.641394:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e383d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583771.641409:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789583771.641562:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65ef expref: 25 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.641580:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e383d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65ef expref: 24 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.641588:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:1.0:1789583771.641591:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789583771.641594:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa400, rc 0) 00000100:00100000:1.0:1789583771.641642:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11378:x1876514313406080:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 472us (1221us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789583771.641649:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 146 00000100:00100000:2.0:1789583771.647800:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.648176:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406336 00000100:00100000:1.0:1789583771.648190:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406336 00000100:00100000:1.0:1789583771.648296:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:1.0:1789583771.648318:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313406336:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:1.0:1789583771.648381:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.648419:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.648430:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583771.648453:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789583771.648459:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.648502:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.648518:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 6 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.648535:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675234a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1876514332283392:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583771.648931:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf240 going to sleep for 11 seconds 00000100:00100000:1.0:1789583771.651537:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675234a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1876514332283392:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583771.651580:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583771.661798:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583771.662570:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406464 00000100:00100000:0.0:1789583771.662595:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406464 00002000:00100000:0.0:1789583771.662647:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88b67b1cfb80 x1876514313406464/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:487/0 lens 504/0 e 0 to 0 dl 1789583782 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583771.662659:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b1cfb80 with x1876514313406464 ext(0->12) 00010000:00010000:0.0:1789583771.662667:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 7 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.662685:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 7 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583771.662693:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88b67b1cfb80 00000100:00100000:0.0:1789583771.662937:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789583771.662948:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313406464:12345-192.168.203.46@tcp:4:lfs.0 00000100:00100000:0.0:1789583771.663490:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2359:x1876514313406464:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 542us (1699us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789583771.663499:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00002000:00100000:0.0:1789583771.663507:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff88b67b1cfb80 x1876514313406464/t4294967305(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:487/0 lens 504/448 e 0 to 0 dl 1789583782 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583771.663517:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b1cfb80 with x1876514313406464 ext(0->12) 00010000:00010000:0.0:1789583771.663524:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 9 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.663538:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 9 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583771.663557:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88b67b1cfb80 00000100:00100000:0.0:1789583771.666767:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.667047:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406592 00000100:00100000:3.0:1789583771.667059:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406592 00010000:00010000:3.0:1789583771.667126:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 9 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583771.667174:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:3.0:1789583771.667186:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313406592:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583771.667205:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789583771.667364:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789583771.667368:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789583771 00002000:00010000:3.0:1789583771.667371:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789583771 00002000:00010000:3.0:1789583771.667373:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789583771 00010000:00010000:3.0:1789583771.667381:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 9 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.667409:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 9 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.667467:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001497d179/0x6d3e73d72c6e37fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65d3 expref: 9 pid: 6705 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.667489:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583771.667495:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583771.667502:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.667515:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.667563:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583771.667767:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313406592:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 581us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583771.667777:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00010000:00010000:1.0:1789583771.668001:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668014:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668047:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668068:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668092:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668100:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583771.668104:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668115:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668130:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.668138:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e384b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.668199:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313406336:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 19893us (20414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.668207:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:1.0:1789583771.676533:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.676759:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406848 00000100:00100000:3.0:1789583771.676773:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406848 00000100:00100000:3.0:1789583771.676865:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:3.0:1789583771.676878:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11378:x1876514313406848:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:3.0:1789583771.676968:0:5851:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e383d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65ef expref: 24 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583771.677469:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789583771.677519:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789583771.681611:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789583771.681756:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.681930:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 28 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.681941:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.681992:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 28 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.682012:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 28 pid: 8280 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583771.682030:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1cea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332283520:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583771.682148:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583771.685774:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.685940:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313406976 00000100:00100000:3.0:1789583771.685953:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313406976 00010000:00010000:3.0:1789583771.686021:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 29 pid: 8280 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583771.686075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:3.0:1789583771.686085:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+29:2358:x1876514313406976:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583771.686105:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583771.686112:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 29 pid: 8280 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.686126:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 29 pid: 8280 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.686153:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:3.0:1789583771.686159:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.686170:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.686178:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.686200:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583771.686273:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+29:2358:x1876514313406976:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 189us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583771.686280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00010000:00010000:0.0:1789583771.686641:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e37e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65c5 expref: 28 pid: 8280 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583771.686663:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1cea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332283520:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583771.686691:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.686701:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583771.686708:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789583771.687300:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789583771.687852:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789583771.688199:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba93b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332283648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583771.688700:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583771.688844:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583771.689567:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332283648 00000100:00100000:2.0:1789583771.689580:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332283648 00000100:00100000:2.0:1789583771.689749:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789583771.689762:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332283648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789583771.689914:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332283648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583771.689922:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789583771.690016:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba93b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332283648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789583771.690847:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789583771.690952:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675234a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332283776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789583771.691012:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583771.691641:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789583771.691720:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332283776 00000100:00100000:0.0:1789583771.691730:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332283776 00000100:00100000:0.0:1789583771.691777:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789583771.691788:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332283776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583771.692032:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1876514332283776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 246us (1020us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789583771.692052:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789583771.692175:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675234a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332283776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789583771.692253:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1789583771.692304:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.692327:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.692336:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.692343:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583771.692348:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.692357:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.692376:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:1.0:1789583771.692379:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789583771.692385:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.692404:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3852 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789583771.692604:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789583771.692774:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789583771.692789:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328676981673ns, next at 329676978837ns, rc = 0 00000001:00080000:1.0:1789583771.692797:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789583771.692883:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4a00) 00010000:00010000:1.0:1789583771.692886:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789583771.692895:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e383d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65ef expref: 32 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.693414:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+31:11378:x1876514313406848:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 16537us (16894us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1789583771.693426:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000020:00080000:1.0:1789583771.693433:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789583771.696279:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.696351:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313407104 00000100:00100000:1.0:1789583771.696363:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313407104 00000100:00100000:1.0:1789583771.696467:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 147 00000100:00100000:1.0:1789583771.696480:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+31:11378:x1876514313407104:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583771.696508:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583771.696535:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3859 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65f6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.696607:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65f6 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.696625:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3859 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65f6 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.696648:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583771.696651:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583771.696655:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfbc00, rc 0) 00000100:00100000:1.0:1789583771.696733:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11378:x1876514313407104:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 256us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.696759:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 147 00000100:00100000:3.0:1789583771.702510:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.702627:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313407360 00000100:00100000:2.0:1789583771.702641:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313407360 00000100:00100000:2.0:1789583771.702710:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:2.0:1789583771.702719:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11378:x1876514313407360:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583771.703174:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+33:11378:x1876514313407360:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 454us (679us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789583771.703183:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:0.0:1789583771.779852:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583771.780062:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313407616 00000100:00100000:3.0:1789583771.780073:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313407616 00000100:00100000:3.0:1789583771.780146:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:3.0:1789583771.780156:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+33:11388:x1876514313407616:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583771.780181:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583771.780418:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec65fd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583771.780650:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789583771.780768:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3860 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65fd expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.780783:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:3.0:1789583771.780786:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583771.780791:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65fd expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583771.780857:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483400, rc 0) 00000100:00100000:3.0:1789583771.780918:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11388:x1876514313407616:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 764us (1116us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1789583771.780925:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:3.0:1789583771.786989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.787093:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313407744 00000100:00100000:1.0:1789583771.787104:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313407744 00000100:00100000:1.0:1789583771.787170:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:1.0:1789583771.787180:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11388:x1876514313407744:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789583771.787266:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787285:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787296:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787320:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787328:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787334:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787425:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787433:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.787441:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583771.788322:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788342:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788348:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788355:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788360:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583771.788364:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788371:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788382:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583771.788385:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583771.788389:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788394:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e386e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788408:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788413:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788428:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788434:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583771.788436:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788442:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788449:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b645246e00) 00010000:00010000:1.0:1789583771.788451:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583771.788453:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788458:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788471:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788477:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788483:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788851:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583771.788856:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788873:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788881:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583771.788884:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583771.788887:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.788893:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e387c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583771.788971:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11388:x1876514313407744:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1790us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583771.788980:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 149 00000100:00100000:0.0:1789583771.798766:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.798857:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313408000 00000100:00100000:1.0:1789583771.798866:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313408000 00000100:00100000:1.0:1789583771.798928:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:1.0:1789583771.798939:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11388:x1876514313408000:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583771.799166:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+35:11388:x1876514313408000:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 229us (414us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1789583771.799174:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789583771.852542:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.852685:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313408256 00000100:00100000:1.0:1789583771.852694:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313408256 00000100:00100000:1.0:1789583771.852750:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:1.0:1789583771.852759:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:11391:x1876514313408256:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583771.852791:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583771.852835:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3883 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6604 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.852918:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.852932:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.852953:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.852969:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.852976:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.852990:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853118:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853127:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853134:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583771.853148:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789583771.853255:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853262:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853275:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853281:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583771.853285:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853293:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853305:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583771.853317:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583771.853322:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853328:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e388a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853341:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853347:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853353:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853358:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583771.853361:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853375:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853382:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b645246e00) 00010000:00010000:1.0:1789583771.853385:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583771.853387:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853393:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3891 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853428:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 38 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853442:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 37 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583771.853448:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583771.853450:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583771.853453:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb600, rc 0) 00000100:00100000:1.0:1789583771.853855:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11391:x1876514313408256:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1095us (1319us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789583771.853863:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 150 00000100:00100000:3.0:1789583771.865001:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583771.865109:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313408384 00000100:00100000:2.0:1789583771.865122:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313408384 00000100:00100000:2.0:1789583771.865191:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:2.0:1789583771.865200:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11391:x1876514313408384:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:2.0:1789583771.865421:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865439:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865451:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865478:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865493:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865502:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865507:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583771.865512:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865518:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865547:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583771.865549:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789583771.865555:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583771.865560:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e38a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583771.865649:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66dec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11391:x1876514313408384:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 449us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583771.865655:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 151 00000100:00100000:0.0:1789583771.869958:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583771.870083:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313408640 00000100:00100000:1.0:1789583771.870095:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313408640 00000100:00100000:1.0:1789583771.870172:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789583771.870184:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11391:x1876514313408640:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583771.870548:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+38:11391:x1876514313408640:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 365us (602us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789583771.870565:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:0.0:1789583772.069462:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583772.072893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313408896 00000100:00100000:3.0:1789583772.072980:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313408896 00000100:00100000:3.0:1789583772.073224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:3.0:1789583772.073239:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+38:11422:x1876514313408896:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:3.0:1789583772.073274:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583772.073302:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e38ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec660b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.073490:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e38b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.073509:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e38b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.073527:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e38b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583772.073540:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789583772.074010:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e38ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec660b expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.074048:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e38b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec660b expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.074058:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583772.074061:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583772.074065:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483c00, rc 0) 00000100:00100000:3.0:1789583772.074155:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11422:x1876514313408896:12345-192.168.203.46@tcp:101:cat.0 Request processed in 921us (4710us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789583772.074164:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:3.0:1789583772.077773:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583772.078226:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313409024 00000100:00100000:0.0:1789583772.078244:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313409024 00000100:00100000:0.0:1789583772.078432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789583772.078444:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+40:2360:x1876514313409024:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583772.078461:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583772.078485:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e38b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec660b expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.078520:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:0.0:1789583772.078526:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583772.078610:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+39:2360:x1876514313409024:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 170us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583772.078617:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:3.0:1789583772.079391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.080447:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313409280 00000100:00100000:1.0:1789583772.080462:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313409280 00000100:00100000:1.0:1789583772.080586:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:1.0:1789583772.080599:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+39:11422:x1876514313409280:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:1.0:1789583772.080969:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11422:x1876514313409280:12345-192.168.203.46@tcp:35:cat.0 Request processed in 361us (1574us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789583772.080977:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:3.0:1789583772.131674:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.131860:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313409536 00000100:00100000:1.0:1789583772.131873:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313409536 00000100:00100000:1.0:1789583772.132062:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:1.0:1789583772.132075:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11428:x1876514313409536:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:1.0:1789583772.132109:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583772.132113:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789583772.132146:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e381a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65e1 expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.132172:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583772.132178:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583772.132331:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e38c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6612 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.136285:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.136358:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 40 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.136368:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.136422:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 40 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.136443:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 40 pid: 8280 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583772.136461:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332283904:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583772.136661:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b651a19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789583772.146522:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583772.146800:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332283904:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583772.146853:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583772.152526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313409664 00000100:00100000:0.0:1789583772.152546:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313409664 00010000:00010000:0.0:1789583772.152612:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 41 pid: 8280 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583772.152725:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789583772.152737:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+41:2358:x1876514313409664:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583772.152776:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583772.152786:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 41 pid: 8280 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.152801:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 41 pid: 8280 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.152845:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6604 expref: 41 pid: 8280 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.152867:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:0.0:1789583772.152873:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.152883:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.152892:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.152932:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583772.153023:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+40:2358:x1876514313409664:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 288us (6515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583772.153031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00010000:00010000:3.0:1789583772.154314:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.154331:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583772.154358:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789583772.154576:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e38c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.154633:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.154643:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583772.154646:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789583772.154650:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482200, rc 0) 00000100:00100000:3.0:1789583772.154725:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11428:x1876514313409536:12345-192.168.203.46@tcp:101:dd.0 Request processed in 22653us (23065us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789583772.154734:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:2.0:1789583772.158968:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.159068:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313409920 00000100:00100000:1.0:1789583772.159089:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313409920 00000100:00100000:1.0:1789583772.159198:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 154 00000100:00100000:1.0:1789583772.159210:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11428:x1876514313409920:12345-192.168.203.46@tcp:36:dd.0 00010000:00010000:1.0:1789583772.159570:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.159591:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.159605:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583772.159663:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1789583772.159692:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034ccab7e reply state 00000000348b9d53 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.159702:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583772.159877:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+43:11428:x1876514313409920:12345-192.168.203.46@tcp:36:dd.0 Request processed in 668us (916us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1789583772.159886:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 154 00000020:00080000:1.0:1789583772.159893:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789583772.162724:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.162742:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.162750:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.162757:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583772.162761:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.162769:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.162784:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583772.162788:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583772.162792:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.162846:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e38d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.199027:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583772.427716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.428914:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313410048 00000100:00100000:1.0:1789583772.428927:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313410048 00000100:00100000:1.0:1789583772.428996:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 155 00000100:00100000:1.0:1789583772.429007:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+42:11442:x1876514313410048:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:1.0:1789583772.429030:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583772.429050:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6619 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429113:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429143:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429156:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429170:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429177:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429184:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429269:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429280:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429288:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429334:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.429348:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 43 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.429387:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675237100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332284032:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583772.429486:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583772.432348:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.432501:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675237100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332284032:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583772.432530:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583772.432792:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313410304 00000100:00100000:0.0:1789583772.432841:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313410304 00000100:00100000:0.0:1789583772.432905:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:0.0:1789583772.432915:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+44:5597:x1876514313410304:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789583772.433490:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+45:5597:x1876514313410304:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 573us (1147us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789583772.433498:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789583772.436654:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.436733:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313410432 00000100:00100000:1.0:1789583772.436744:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313410432 00010000:00010000:1.0:1789583772.436785:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 45 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.436862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:1.0:1789583772.436873:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+45:2359:x1876514313410432:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583772.436889:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583772.436896:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 45 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.436909:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 45 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.436933:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e38c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6612 expref: 45 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.436951:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583772.436956:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.436989:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.436997:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.437029:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583772.437097:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+44:2359:x1876514313410432:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 225us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583772.437105:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00010000:00010000:2.0:1789583772.437189:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437199:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583772.437239:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789583772.437244:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583772.437268:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437281:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437313:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437320:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437327:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437333:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfae00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583772.437338:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437346:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437355:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:2.0:1789583772.437358:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583772.437372:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437378:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e38e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437389:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437395:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437401:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437413:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583772.437416:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437422:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437431:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b645246e00) 00010000:00010000:2.0:1789583772.437434:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583772.437437:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437443:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e38ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437480:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6619 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437492:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6619 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.437498:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583772.437501:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583772.437503:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfba00, rc 0) 00000100:00100000:2.0:1789583772.437537:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+43:11442:x1876514313410048:12345-192.168.203.46@tcp:101:stat.0 Request processed in 8532us (9830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583772.437545:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 155 00000100:00100000:2.0:1789583772.506358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.507360:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313410688 00000100:00100000:1.0:1789583772.507372:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313410688 00000100:00100000:1.0:1789583772.507440:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 156 00000100:00100000:1.0:1789583772.507451:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+43:11448:x1876514313410688:12345-192.168.203.46@tcp:36:truncate.0 00010000:00010000:1.0:1789583772.507508:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583772.507535:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e38f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6619 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.507555:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583772.507560:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583772.507765:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.507781:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.507790:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583772.507896:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1789583772.507923:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000006bc548 reply state 000000007f58b3c1 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.507932:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583772.508040:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+45:11448:x1876514313410688:12345-192.168.203.46@tcp:36:truncate.0 Request processed in 591us (1691us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789583772.508056:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 156 00000020:00080000:1.0:1789583772.508062:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789583772.516528:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.516546:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.516555:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.516562:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583772.516567:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.516574:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.516591:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:0.0:1789583772.516594:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583772.516599:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.516605:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e38fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583772.657635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583772.657972:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313410816 00000100:00100000:3.0:1789583772.657983:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313410816 00000100:00100000:3.0:1789583772.658041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 157 00000100:00100000:3.0:1789583772.658052:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+44:11462:x1876514313410816:12345-192.168.203.46@tcp:101:stat.0 00010000:00010000:3.0:1789583772.658076:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583772.658097:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3901 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6620 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658162:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658176:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658189:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658202:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658223:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658236:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658332:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658352:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658359:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583772.658395:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789583772.658399:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583772.658423:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658434:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658442:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658448:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658455:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658460:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583772.658464:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658471:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658481:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:3.0:1789583772.658489:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583772.658495:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658501:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658517:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658523:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658528:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658533:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583772.658535:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658541:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658548:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b64336a100) 00010000:00010000:3.0:1789583772.658551:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583772.658553:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658559:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e390f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658593:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3901 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 46 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658620:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 45 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.658627:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583772.658630:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583772.658632:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483200, rc 0) 00000100:00100000:3.0:1789583772.659001:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+45:11462:x1876514313410816:12345-192.168.203.46@tcp:101:stat.0 Request processed in 948us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583772.659009:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 157 00000100:00100000:3.0:1789583772.762341:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.762607:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313411072 00000100:00100000:1.0:1789583772.762629:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313411072 00000100:00100000:1.0:1789583772.762705:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 158 00000100:00100000:1.0:1789583772.762717:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+45:11472:x1876514313411072:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583772.762744:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583772.762771:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e391d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6627 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583772.762931:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789583772.763092:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e391d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6627 expref: 47 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.763109:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:1.0:1789583772.763112:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583772.763119:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e391d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6627 expref: 47 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.763137:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfba00, rc 0) 00000100:00100000:1.0:1789583772.763235:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+46:11472:x1876514313411072:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 521us (910us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1789583772.763243:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 158 00000100:00100000:0.0:1789583772.767288:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.767369:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313411328 00000100:00100000:1.0:1789583772.767386:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313411328 00000100:00100000:1.0:1789583772.767803:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:1.0:1789583772.767849:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+46:11472:x1876514313411328:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583772.768359:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511edc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+47:11472:x1876514313411328:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 512us (1078us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1789583772.768369:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:2.0:1789583772.821058:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.821187:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313411584 00000100:00100000:1.0:1789583772.821201:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313411584 00000100:00100000:1.0:1789583772.821275:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 159 00000100:00100000:1.0:1789583772.821286:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+47:11478:x1876514313411584:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789583772.821329:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583772.821354:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e392b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec662e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.821497:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.821517:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.821527:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.821570:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.821608:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 48 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.821630:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b675237100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332284160:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583772.821747:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583772.825024:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583772.825224:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313411712 00000100:00100000:2.0:1789583772.825236:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313411712 00010000:00010000:2.0:1789583772.825288:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 49 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583772.825345:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:2.0:1789583772.825357:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+49:2359:x1876514313411712:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583772.825378:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583772.825396:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 49 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.825411:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 49 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.825438:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583772.825444:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.825454:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.825463:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583772.825486:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583772.825567:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+49:2359:x1876514313411712:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 212us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583772.825588:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00010000:00010000:1.0:1789583772.825887:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6620 expref: 48 pid: 5850 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.825909:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b675237100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332284160:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583772.825937:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.825947:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.825953:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583772.825976:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789583772.826177:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e392b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 49 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.826195:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 48 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.826203:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583772.826213:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789583772.826216:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb200, rc 0) 00000100:00100000:1.0:1789583772.826250:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+48:11478:x1876514313411584:12345-192.168.203.46@tcp:101:bash.0 Request processed in 4966us (5206us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789583772.826258:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 159 00000100:00100000:0.0:1789583772.835667:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.837688:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313411968 00000100:00100000:1.0:1789583772.837708:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313411968 00000100:00100000:1.0:1789583772.837893:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 160 00000100:00100000:1.0:1789583772.837906:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+48:11478:x1876514313411968:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:1.0:1789583772.838274:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.838297:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.838321:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583772.838399:0:8280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1789583772.838428:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005439d274 reply state 000000000b9e1790 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.838439:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583772.838578:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+51:11478:x1876514313411968:12345-192.168.203.46@tcp:36:bash.0 Request processed in 674us (2925us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789583772.838586:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 160 00000020:00080000:1.0:1789583772.838591:0:8280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789583772.841943:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.841968:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.841995:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.842001:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583772.842006:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.842016:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.842036:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583772.842039:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583772.842046:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.842052:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3940 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583772.847724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583772.847940:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313412096 00000100:00100000:3.0:1789583772.847953:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313412096 00000100:00100000:3.0:1789583772.848029:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 161 00000100:00100000:3.0:1789583772.848041:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+50:11478:x1876514313412096:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789583772.848072:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583772.848098:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6635 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.848224:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.848242:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.848251:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.848311:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583772.848328:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 51 pid: 5849 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583772.848344:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332284288:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583772.849158:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b651a19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583772.854962:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.856135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313412224 00000100:00100000:1.0:1789583772.856154:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313412224 00010000:00010000:1.0:1789583772.856220:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 52 pid: 5849 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.856333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:1.0:1789583772.856345:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:2359:x1876514313412224:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583772.856363:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583772.856371:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 52 pid: 5849 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.856423:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 52 pid: 5849 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.856454:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583772.856461:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.856471:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.856480:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.856503:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583772.856590:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:2359:x1876514313412224:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 247us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583772.856599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00010000:00010000:0.0:1789583772.857919:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3932 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec662e expref: 51 pid: 5849 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583772.857946:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752db480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332284288:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583772.857978:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.857989:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.857995:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583772.858055:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789583772.858061:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583772.858086:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.858128:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6635 expref: 51 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.858148:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6635 expref: 50 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583772.858156:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:0.0:1789583772.858159:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583772.858163:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483400, rc 0) 00000100:00100000:0.0:1789583772.858446:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+50:11478:x1876514313412096:12345-192.168.203.46@tcp:101:bash.0 Request processed in 10405us (10736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583772.858455:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 161 00000100:00100000:3.0:1789583772.865424:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583772.865770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313412480 00000100:00100000:0.0:1789583772.865783:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313412480 00000100:00100000:0.0:1789583772.865886:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:0.0:1789583772.865898:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+50:11478:x1876514313412480:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:0.0:1789583772.866207:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+51:11478:x1876514313412480:12345-192.168.203.46@tcp:35:bash.0 Request processed in 310us (804us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789583772.866216:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:3.0:1789583772.970244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.970393:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313412736 00000100:00100000:1.0:1789583772.970406:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313412736 00000100:00100000:1.0:1789583772.970491:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 162 00000100:00100000:1.0:1789583772.970503:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+51:11488:x1876514313412736:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583772.970535:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583772.970560:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec663c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583772.971032:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789583772.971200:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3955 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec663c expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.971235:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:1.0:1789583772.971239:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583772.971246:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec663c expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.971264:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfba00, rc 0) 00000100:00100000:1.0:1789583772.971359:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11488:x1876514313412736:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 859us (1130us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789583772.971368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 162 00000100:00100000:3.0:1789583772.977933:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.978046:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313412864 00000100:00100000:1.0:1789583772.978056:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313412864 00000100:00100000:1.0:1789583772.978114:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 163 00000100:00100000:1.0:1789583772.978124:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11488:x1876514313412864:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789583772.978197:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978213:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978223:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978236:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978243:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978265:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978365:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978375:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978383:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583772.978425:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978438:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978444:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978452:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978458:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfae00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583772.978463:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978471:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978482:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583772.978490:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583772.978496:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978503:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3963 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978519:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978524:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978530:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978535:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583772.978538:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978543:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978549:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b645246200) 00010000:00010000:1.0:1789583772.978552:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583772.978554:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978560:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e396a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978574:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978589:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978595:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978674:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583772.978678:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978684:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978693:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583772.978696:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583772.978699:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583772.978704:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583772.978777:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11488:x1876514313412864:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 654us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583772.978785:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 163 00000100:00100000:3.0:1789583772.984506:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583772.985107:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313413120 00000100:00100000:1.0:1789583772.985117:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313413120 00000100:00100000:1.0:1789583772.985176:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:1.0:1789583772.985188:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11488:x1876514313413120:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583772.985458:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+53:11488:x1876514313413120:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 271us (961us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789583772.985478:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:3.0:1789583773.036636:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.036745:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313413376 00000100:00100000:2.0:1789583773.036758:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313413376 00000100:00080000:1.0:1789583773.036904:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583773.037162:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:1.0:1789583773.037177:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+53:11491:x1876514313413376:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583773.037201:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583773.037221:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6643 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037319:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037333:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037344:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037357:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037364:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037370:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037474:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e398d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037482:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e398d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037496:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e398d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583773.037505:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789583773.037590:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037598:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037604:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037610:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.037614:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037622:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037634:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583773.037637:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583773.037641:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037648:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e397f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037662:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037668:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037679:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037684:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfae00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.037687:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037693:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037700:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b645246200) 00010000:00010000:1.0:1789583773.037702:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583773.037705:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037711:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3986 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037758:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6643 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037771:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e398d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6643 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.037778:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.037780:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583773.037782:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfba00, rc 0) 00000100:00100000:1.0:1789583773.038053:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11491:x1876514313413376:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 872us (1432us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1789583773.038070:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 164 00000100:00100000:3.0:1789583773.044726:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.044844:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313413504 00000100:00100000:1.0:1789583773.044855:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313413504 00000100:00100000:1.0:1789583773.044924:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 165 00000100:00100000:1.0:1789583773.044935:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11491:x1876514313413504:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:1.0:1789583773.045003:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045020:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045034:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045060:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045067:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045074:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045080:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.045084:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045091:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045102:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.045118:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583773.045124:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.045130:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e399b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.045197:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11491:x1876514313413504:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 263us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.045204:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 165 00000100:00100000:3.0:1789583773.047682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.047787:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313413632 00000100:00100000:2.0:1789583773.047796:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313413632 00000100:00100000:2.0:1789583773.047873:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789583773.047882:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+55:2358:x1876514313413632:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583773.047895:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583773.047924:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e398d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6643 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.047943:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583773.047947:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583773.047997:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+54:2358:x1876514313413632:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583773.048004:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789583773.055221:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.055313:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313413888 00000100:00100000:0.0:1789583773.055323:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313413888 00000100:00100000:0.0:1789583773.055383:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:0.0:1789583773.055392:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+54:11491:x1876514313413888:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789583773.055635:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11491:x1876514313413888:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 244us (423us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789583773.055643:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00010000:00010000:1.0:1789583773.223342:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583773.238623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.243729:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313414144 00000100:00100000:1.0:1789583773.243744:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313414144 00000100:00100000:1.0:1789583773.244121:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:1.0:1789583773.244133:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11509:x1876514313414144:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:1.0:1789583773.244157:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583773.244188:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec664a expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.244292:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e39a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.244318:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e39a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.244330:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e39a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583773.244341:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789583773.244456:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec664a expref: 58 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.244490:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e39a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec664a expref: 57 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.244498:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.244501:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789583773.244504:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfaa00, rc 0) 00000100:00100000:1.0:1789583773.244570:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11509:x1876514313414144:12345-192.168.203.46@tcp:101:cat.0 Request processed in 441us (5955us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789583773.244576:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 166 00000100:00100000:3.0:1789583773.263795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.264464:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313414272 00000100:00100000:1.0:1789583773.264475:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313414272 00000100:00100000:1.0:1789583773.264535:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 167 00000100:00100000:1.0:1789583773.264545:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11510:x1876514313414272:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583773.264568:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583773.264588:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6651 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.264650:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e39be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.264663:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e39be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.264674:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e39be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583773.264708:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789583773.264725:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583773.264745:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e39be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.264769:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6651 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.264787:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e39be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6651 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.264794:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583773.264797:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583773.264800:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583773.265466:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11510:x1876514313414272:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 919us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.265474:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 167 00000100:00100000:2.0:1789583773.275507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.275722:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313414656 00000100:00100000:1.0:1789583773.275735:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313414656 00000100:00100000:1.0:1789583773.275848:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:1.0:1789583773.275862:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11510:x1876514313414656:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:1.0:1789583773.276322:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11510:x1876514313414656:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 463us (826us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789583773.276332:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:3.0:1789583773.283747:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.284013:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313414784 00000100:00100000:2.0:1789583773.284027:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313414784 00000100:00100000:2.0:1789583773.284113:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:2.0:1789583773.284125:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11510:x1876514313414784:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:2.0:1789583773.284145:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789583773.284180:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e394e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6635 expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.284236:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e39a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec664a expref: 58 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.284251:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3859 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65f6 expref: 57 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.284262:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583773.284275:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583773.284363:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+56:11510:x1876514313414784:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 241us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583773.284372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:3.0:1789583773.288087:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.288279:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313414912 00000100:00100000:1.0:1789583773.288293:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313414912 00000100:00100000:1.0:1789583773.288376:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:1.0:1789583773.288387:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+56:11510:x1876514313414912:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:1.0:1789583773.288562:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.288581:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.288594:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583773.289260:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789583773.289679:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+56:11510:x1876514313414912:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 1289us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.289691:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 168 00000100:00100000:3.0:1789583773.312314:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.312532:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313415040 00000100:00100000:0.0:1789583773.312545:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313415040 00000100:00100000:0.0:1789583773.312673:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 169 00000100:00100000:0.0:1789583773.312684:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+56:11512:x1876514313415040:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583773.312711:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583773.312738:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e39cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6658 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.312986:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313003:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313039:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313058:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313066:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313073:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313185:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313195:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313202:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583773.313245:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789583773.313251:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583773.313273:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313288:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313308:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313326:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313333:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313340:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752ca400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583773.313345:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313354:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313367:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583773.313370:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583773.313374:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313384:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e39d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313402:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313408:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313413:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313417:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583773.313426:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313432:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313440:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76400) 00010000:00010000:0.0:1789583773.313443:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583773.313445:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313450:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e39da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313500:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e39cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313515:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.313523:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:0.0:1789583773.313525:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583773.313528:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752caa00, rc 0) 00000100:00100000:0.0:1789583773.313732:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11512:x1876514313415040:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1049us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583773.313742:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 169 00000040:00080000:2.0:1789583773.548335:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583773.548348:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583773.548400:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789583773.548408:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789583773.549314:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b674c7b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332284416:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789583773.549496:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583773.565979:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b674c7b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332284416:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789583773.566683:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.566843:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313415168 00000100:00100000:1.0:1789583773.566854:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313415168 00000100:00100000:1.0:1789583773.566930:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 170 00000100:00100000:1.0:1789583773.566941:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11523:x1876514313415168:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789583773.567002:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789583773.567149:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11523:x1876514313415168:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 208us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.567158:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 170 00000100:00100000:1.0:1789583773.576706:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.576835:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313415296 00000100:00100000:2.0:1789583773.576848:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313415296 00000100:00100000:2.0:1789583773.576935:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 171 00000100:00100000:2.0:1789583773.576948:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11523:x1876514313415296:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789583773.577058:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.577080:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.577109:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.582925:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.582949:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.582963:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583016:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583027:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583033:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583773.583080:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789583773.583084:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583773.583099:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583112:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583119:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583142:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583148:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583773.583152:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583159:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583170:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:2.0:1789583773.583173:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583773.583178:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583184:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e39e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583199:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583205:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583210:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583215:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583773.583218:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583233:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583241:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff88b6583d4700) 00010000:00010000:2.0:1789583773.583244:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583773.583247:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583253:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e39ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583269:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583275:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583280:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583285:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583773.583287:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583292:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583311:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:2.0:1789583773.583314:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583773.583317:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.583332:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583773.583430:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11523:x1876514313415296:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 6481us (6735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583773.583439:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 171 00000100:00100000:1.0:1789583773.591796:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.597753:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313415552 00000100:00100000:2.0:1789583773.597776:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313415552 00000100:00100000:2.0:1789583773.598192:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 172 00000100:00100000:2.0:1789583773.598206:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11523:x1876514313415552:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583773.598235:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583773.598265:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec665f expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598425:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598444:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598458:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583773.598472:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789583773.598619:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598628:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598657:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598664:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583773.598677:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598687:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598700:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:2.0:1789583773.598704:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583773.598709:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598716:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3a04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598768:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39fd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec665f expref: 59 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598779:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:2.0:1789583773.598781:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789583773.598786:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e39fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec665f expref: 59 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.598795:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0a00, rc 0) 00000100:00100000:2.0:1789583773.598926:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11523:x1876514313415552:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 722us (7143us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789583773.598945:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 172 00000100:00100000:0.0:1789583773.604713:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.605175:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313415680 00000100:00100000:2.0:1789583773.605200:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313415680 00000100:00100000:2.0:1789583773.605273:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:2.0:1789583773.605285:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11523:x1876514313415680:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789583773.605346:0:5850:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789583773.605502:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11523:x1876514313415680:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 218us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583773.605511:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 173 00000100:00100000:2.0:1789583773.615817:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.615861:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313415936 00000100:00100000:2.0:1789583773.615873:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313415936 00000100:00100000:2.0:1789583773.615945:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:2.0:1789583773.615956:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11523:x1876514313415936:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583773.615984:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583773.615988:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789583773.616034:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e39be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6651 expref: 58 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.616060:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:2.0:1789583773.616065:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583773.616081:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3a12 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6666 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789583773.616732:0:8280:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789583773.617023:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3a19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.617047:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.617060:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3a19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.617126:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3a12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6666 expref: 60 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.617146:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3a19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6666 expref: 59 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.617155:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b6583d4700) 00010000:00010000:2.0:1789583773.617157:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583773.617160:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583773.617238:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11523:x1876514313415936:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1284us (1448us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789583773.617248:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 174 00000100:00100000:2.0:1789583773.628414:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.628538:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313416192 00000100:00100000:1.0:1789583773.628553:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313416192 00000100:00100000:1.0:1789583773.628633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 175 00000100:00100000:1.0:1789583773.628645:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11523:x1876514313416192:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789583773.628745:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583773.628779:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3a19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6666 expref: 59 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.628802:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b6583d4700) 00010000:00010000:1.0:1789583773.628836:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583773.628866:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.628882:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.628893:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.634511:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.634536:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.634549:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639440:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639458:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639467:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639489:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.639494:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639502:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639520:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583773.639524:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583773.639530:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639538:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3a27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639556:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639562:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639569:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639574:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.639577:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639584:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639789:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd159faa2 (ffff88b645246000) 00010000:00010000:1.0:1789583773.639792:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583773.639795:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.639802:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd159faa2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.639949:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11523:x1876514313416192:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 11301us (11543us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583773.639958:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 175 00000100:00100000:3.0:1789583773.642413:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.642550:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313416320 00000100:00100000:1.0:1789583773.642564:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313416320 00000100:00100000:1.0:1789583773.642774:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 176 00000100:00100000:1.0:1789583773.642785:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11523:x1876514313416320:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583773.642839:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583773.642862:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3a35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec666d expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.642899:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.642912:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.642924:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.643017:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3a35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 60 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.643048:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 59 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.643057:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.643061:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789583773.643065:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb200, rc 0) 00000100:00100000:1.0:1789583773.643138:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11523:x1876514313416320:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 355us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.643146:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 176 00000100:00100000:3.0:1789583773.651500:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.651558:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313416576 00000100:00100000:3.0:1789583773.651571:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313416576 00000100:00100000:3.0:1789583773.651654:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 177 00000100:00100000:3.0:1789583773.651667:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11523:x1876514313416576:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789583773.651778:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.651802:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.651836:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789583773.653560:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789583773.653585:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330637778351ns, next at 331637774774ns, rc = 0 00000004:00010000:3.0:1789583773.654350:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e46ebd3 reply state 0000000057b3fd06 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583773.654368:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583773.654543:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11523:x1876514313416576:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 2873us (3051us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789583773.654554:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 177 00010000:00010000:2.0:1789583773.658477:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.658501:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.658511:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.658518:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583773.658543:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.658553:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.658574:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583773.658578:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789583773.658583:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.658590:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583773.659616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.660051:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313416704 00000100:00100000:3.0:1789583773.660064:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313416704 00000100:00100000:3.0:1789583773.660163:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 178 00000100:00100000:3.0:1789583773.660189:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11523:x1876514313416704:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583773.660221:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583773.660248:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6674 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.660334:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 61 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.660364:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 61 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.660453:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583773.660457:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583773.660461:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482a00, rc 0) 00000100:00100000:3.0:1789583773.660546:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11523:x1876514313416704:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 373us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583773.660553:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 178 00000100:00100000:0.0:1789583773.675385:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.683315:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313416832 00000100:00100000:3.0:1789583773.683336:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313416832 00000100:00100000:0.0:1789583773.683853:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:0.0:1789583773.683869:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313416832:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789583773.684223:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313416832:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 357us (8851us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789583773.684231:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00080000:1.0:1789583773.685542:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583773.696728:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.697001:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313417088 00000100:00100000:3.0:1789583773.697011:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313417088 00000100:00100000:3.0:1789583773.697070:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:3.0:1789583773.697080:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11523:x1876514313417088:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789583773.697322:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11523:x1876514313417088:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 243us (602us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789583773.697329:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:2.0:1789583773.707048:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.707643:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313417344 00000100:00100000:3.0:1789583773.707660:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313417344 00000100:00100000:1.0:1789583773.707834:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 179 00000100:00100000:1.0:1789583773.707849:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11523:x1876514313417344:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789583773.707977:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675089880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11523:x1876514313417344:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 131us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.707985:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 179 00000100:00100000:2.0:1789583773.710195:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.710654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313417472 00000100:00100000:3.0:1789583773.710667:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313417472 00000100:00100000:3.0:1789583773.710752:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 180 00000100:00100000:3.0:1789583773.710764:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11523:x1876514313417472:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583773.710801:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583773.710887:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec667b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.710989:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.711007:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.711021:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583773.711068:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583773.711091:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.711124:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3a51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec667b expref: 64 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.711148:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec667b expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583773.711158:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:3.0:1789583773.711161:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789583773.711166:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483400, rc 0) 00000100:00100000:3.0:1789583773.711252:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+63:11523:x1876514313417472:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 489us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583773.711260:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 180 00000100:00100000:3.0:1789583773.717357:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.719301:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313417600 00000100:00100000:1.0:1789583773.719323:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313417600 00000100:00100000:1.0:1789583773.719405:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789583773.719416:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313417600:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583773.719437:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583773.719465:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6682 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583773.719510:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaae19d, blocks: 0x1 00010000:00010000:1.0:1789583773.719547:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1789583773.719552:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583773.719564:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.719585:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.719610:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfaa00, rc 0) 00000100:00100000:1.0:1789583773.719692:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313417600:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 279us (2350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.719700:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789583773.724617:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.724697:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313417856 00000100:00100000:3.0:1789583773.724726:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313417856 00000100:00100000:3.0:1789583773.724834:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:3.0:1789583773.724847:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+63:11523:x1876514313417856:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789583773.724996:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+63:11523:x1876514313417856:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 152us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583773.725004:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 181 00000100:00100000:0.0:1789583773.735405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.735678:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313417984 00000100:00100000:2.0:1789583773.735690:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313417984 00000100:00100000:2.0:1789583773.735772:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:2.0:1789583773.735786:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:11523:x1876514313417984:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583773.735841:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583773.735867:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6689 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.735927:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.735938:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583773.735953:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583773.735960:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.736005:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.736023:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583773.736039:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332284544:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583773.736155:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583773.741030:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332284544:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583773.741086:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.741115:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1600, rc 0) 00000100:00100000:0.0:1789583773.741201:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:11523:x1876514313417984:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 5417us (5810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583773.741214:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:3.0:1789583773.742028:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.742278:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313418112 00000100:00100000:0.0:1789583773.742290:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313418112 00010000:00010000:0.0:1789583773.742350:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583773.742397:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:0.0:1789583773.742408:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313418112:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583773.742426:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583773.742456:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.742472:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.742522:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3a5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6682 expref: 9 pid: 6704 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.742545:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583773.742550:0:8527:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583773.742560:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.742573:0:8527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.742619:0:8527:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583773.742637:0:8527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba93b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8527:1876514332284672:192.168.203.46@tcp:105: 00000100:00100000:0.0:1789583773.742725:0:8527:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583773.747201:0:8527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba93b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8527:1876514332284672:192.168.203.46@tcp:105: 00010000:00010000:0.0:1789583773.747237:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583773.747320:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313418112:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 4913us (5296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583773.747334:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:1.0:1789583773.749032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.749133:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313418240 00000100:00100000:0.0:1789583773.749146:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313418240 00002000:00100000:0.0:1789583773.749212:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88b675235180 x1876514313418240/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:489/0 lens 504/0 e 0 to 0 dl 1789583784 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583773.749241:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b675235180 with x1876514313418240 ext(0->8) 00002000:00010000:0.0:1789583773.749249:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b675235180 00000100:00100000:0.0:1789583773.749325:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583773.749336:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313418240:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789583773.752634:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2358:x1876514313418240:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 3282us (3596us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789583773.752651:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00002000:00100000:0.0:1789583773.752667:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff88b675235180 x1876514313418240/t4294967314(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:489/0 lens 504/448 e 0 to 0 dl 1789583784 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789583773.752679:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b675235180 with x1876514313418240 ext(0->8) 00002000:00010000:0.0:1789583773.752687:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b675235180 00000100:00100000:1.0:1789583773.759924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583773.762057:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313418368 00000100:00100000:3.0:1789583773.762077:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313418368 00000100:00100000:3.0:1789583773.762234:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 182 00000100:00100000:3.0:1789583773.762247:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+63:11523:x1876514313418368:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789583773.861524:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b97e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+63:11523:x1876514313418368:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 99263us (101597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583773.861543:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 182 00000001:00080000:2.0:1789583773.863167:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:2.0:1789583773.863205:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:2.0:1789583773.863259:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789583773.863279:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b64a7bfd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789583773.863284:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b66dfaba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b64a7bf240 00000020:00080000:2.0:1789583773.863288:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b66dfabe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b64904d400 00000001:00080000:2.0:1789583773.863317:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1789583773.863336:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1789583773.863343:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789583773.863526:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789583773.863978:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789583773.864075:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332284800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789583773.864164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583773.864237:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583773.864251:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b649040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332284928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789583773.864278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583773.864336:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332284800 00000100:00100000:2.0:1789583773.864346:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332284800 00000100:00100000:2.0:1789583773.864409:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332284928 00000100:00100000:2.0:1789583773.864412:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332284928 00000100:00100000:2.0:1789583773.864440:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789583773.864449:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332284800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789583773.864484:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789583773.864527:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aaae19b, atime: 0x6aaae19b, ctime: 0x6aaae19b, blocks: 0x1 00010000:00010000:2.0:1789583773.864536:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.864558:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1789583773.864564:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583773.864572:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.864593:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.868090:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.868112:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.868148:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583773.869866:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583773.869883:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.869908:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583773.869914:0:7652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.869927:0:7652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.869954:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.869979:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e12e480/0x6d3e73d72c6e3a6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.870004:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583773.870006:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583773.870008:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583773.871160:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.871404:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332284800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6952us (7236us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789583773.871417:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789583773.871454:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313418496 00000100:00100000:2.0:1789583773.871463:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313418496 00000100:00100000:2.0:1789583773.871499:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789583773.871509:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332284928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789583773.871697:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789583773.871701:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789583773 00002000:00010000:2.0:1789583773.871704:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789583773.871706:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789583773 -> 1789583773 00002000:00010000:2.0:1789583773.871709:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:0.0:1789583773.871888:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b649040380/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789583773.873225:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b649040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332284928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1789583773.873264:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b67508b800/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789583773.873269:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67508b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332284800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789583773.874019:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332284928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2504us (9732us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789583773.874035:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789583773.874082:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:2.0:1789583773.874098:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2358:x1876514313418496:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1789583773.874191:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789583773.874198:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583773.949544:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2358:x1876514313418496:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 75437us (78379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583773.949560:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000001:00080000:1.0:1789583773.950542:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:1.0:1789583773.950570:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1789583773.954723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.954910:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313418752 00000100:00100000:1.0:1789583773.954922:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313418752 00000100:00100000:1.0:1789583773.954992:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 183 00000100:00100000:1.0:1789583773.955004:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11523:x1876514313418752:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789583773.955083:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583773.955119:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483400/0x6d3e73d72c6e3a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec667b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.955143:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.955159:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583773.955215:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.955233:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.955244:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583773.955574:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000581e74f0 reply state 00000000e0c05d32 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.955585:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583773.955723:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:11523:x1876514313418752:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 720us (1013us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789583773.955893:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 183 00010000:00010000:0.0:1789583773.958520:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.958544:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.958553:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.958560:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583773.958566:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.958575:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.958597:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:0.0:1789583773.958618:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583773.958626:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.958633:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3a74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583773.963635:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.964017:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313418880 00000100:00100000:0.0:1789583773.964030:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313418880 00000100:00100000:0.0:1789583773.964243:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:0.0:1789583773.964256:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313418880:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789583773.964575:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789583773.964580:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789583773 -> 1789583772 00002000:00010000:0.0:1789583773.964582:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789583771 00002000:00010000:0.0:1789583773.964584:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789583773 -> 1789583772 00002000:00010000:0.0:1789583773.964587:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789583773.964786:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313418880:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 532us (1167us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789583773.964796:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:3.0:1789583773.966902:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.967250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313419136 00000100:00100000:2.0:1789583773.967263:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313419136 00000100:00100000:2.0:1789583773.967373:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:2.0:1789583773.967385:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11523:x1876514313419136:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789583773.967563:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.967585:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 18 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.967593:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.967683:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 18 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.967694:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 18 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583773.967708:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b649041880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332285056:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583773.968084:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cc900 going to sleep for 11 seconds 00000100:00100000:0.0:1789583773.970953:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b649041880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332285056:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583773.970999:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.971068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313419264 00010000:00010000:0.0:1789583773.971068:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.971077:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313419264 00010000:00010000:1.0:1789583773.971126:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.971170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:1.0:1789583773.971182:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:2358:x1876514313419264:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583773.971201:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583773.971209:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.971222:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.971270:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec666d expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.971286:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.971302:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.971313:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.971322:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.971358:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583773.971630:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971639:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971677:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971686:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971705:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971711:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583773.971716:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971725:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971735:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:2.0:1789583773.971738:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789583773.971743:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.971750:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3a7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.972168:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+18:2358:x1876514313419264:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 986us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.972179:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583773.972280:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+17:11523:x1876514313419136:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 4898us (5484us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789583773.972288:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 184 00000100:00100000:3.0:1789583773.974574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583773.974872:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313419392 00000100:00100000:2.0:1789583773.974885:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313419392 00000100:00100000:2.0:1789583773.974960:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:2.0:1789583773.974973:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2360:x1876514313419392:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789583773.975036:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.975071:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.975100:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583773.975105:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789583773.975111:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.975155:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583773.975361:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 8 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583773.975382:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b649042300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332285184:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583773.976109:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583773.979141:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b649042300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332285184:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583773.979188:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583773.981166:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.981597:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313419520 00000100:00100000:0.0:1789583773.981620:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313419520 00010000:00010000:0.0:1789583773.981672:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 9 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583773.981747:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:0.0:1789583773.981758:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313419520:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583773.981778:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583773.981848:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 9 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.981863:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 9 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.981900:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b036190e/0x6d3e73d72c6e3a66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6689 expref: 9 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.981922:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583773.981927:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583773.981934:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.981945:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.981977:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583773.982183:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313419520:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 425us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583773.982192:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00010000:00010000:1.0:1789583773.982278:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982288:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982333:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982342:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982358:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982366:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583773.982370:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982382:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982396:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.982403:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e3a82 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.982461:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b198000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2360:x1876514313419392:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 7491us (7900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.982469:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:3.0:1789583773.985471:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583773.985637:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313419776 00000100:00100000:1.0:1789583773.985651:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313419776 00000100:00100000:1.0:1789583773.985731:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 185 00000100:00100000:1.0:1789583773.985743:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+17:11523:x1876514313419776:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789583773.985896:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.985929:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.985945:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.986192:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.986205:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 18 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.986214:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.986260:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 18 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.986278:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 18 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.986303:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332285312:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583773.986391:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66678a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789583773.989932:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332285312:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583773.989971:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583773.990936:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583773.992138:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313419904 00000100:00100000:0.0:1789583773.992154:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313419904 00010000:00010000:1.0:1789583773.992281:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.992359:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:1.0:1789583773.992371:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+19:2358:x1876514313419904:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583773.992405:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583773.992414:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.992428:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.992454:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482a00/0x6d3e73d72c6e3a4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6674 expref: 19 pid: 8280 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.992474:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.992481:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.992491:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.992500:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.992900:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583773.992986:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+18:2358:x1876514313419904:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 614us (2054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583773.992996:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00010000:00010000:0.0:1789583773.994179:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583773.994197:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583773.995024:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1789583773.995226:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789583773.995278:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1789583773.995409:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5849:1876514332285440:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789583773.995509:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583773.995556:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661d02d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583773.995786:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332285440 00000100:00100000:0.0:1789583773.995797:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332285440 00000100:00100000:0.0:1789583773.995901:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789583773.995913:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876514332285440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789583773.996017:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876514332285440:12345-0@lo:1000:mdt00_001.0 Request processed in 105us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583773.996025:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583773.996250:0:5849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1789583773.996257:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b649040380, transno 4294967315 00000100:00100000:1.0:1789583773.996280:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b64a1df100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5849:1876514332285440:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789583773.997666:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789583773.997764:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b980380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5849:1876514332285568:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789583773.997860:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583773.998017:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583773.998108:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332285568 00000100:00100000:0.0:1789583773.998117:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332285568 00000100:00100000:0.0:1789583773.998178:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789583773.998189:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876514332285568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789583773.998442:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b980000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1876514332285568:12345-0@lo:1000:mdt00_001.0 Request processed in 255us (582us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789583773.998451:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583773.998661:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b980380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5849:1876514332285568:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789583773.998710:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998722:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998731:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998739:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfae00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.998745:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998755:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998775:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b645246400) 00010000:00010000:1.0:1789583773.998790:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583773.998798:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998843:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3a90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.998885:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999008:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999015:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999020:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583773.999023:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999030:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999039:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:1.0:1789583773.999041:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583773.999045:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999050:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e39c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999075:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999102:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999111:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999142:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583773.999158:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 21 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583773.999172:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b981f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332285696:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583773.999316:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789583774.003567:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583774.003573:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b981f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332285696:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583774.003619:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.004121:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313420032 00000100:00100000:0.0:1789583774.004130:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313420032 00010000:00010000:0.0:1789583774.004178:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 22 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.004224:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:0.0:1789583774.004236:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+22:2358:x1876514313420032:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583774.004274:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583774.004283:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 22 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.004307:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 22 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.004333:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e39e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6658 expref: 22 pid: 5850 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.004355:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:0.0:1789583774.004361:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.004373:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.004383:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.004420:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583774.004493:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:2358:x1876514313420032:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 259us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.004502:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 72 00010000:00010000:2.0:1789583774.005065:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005076:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005102:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005110:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005117:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005125:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583774.005131:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005140:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005152:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:2.0:1789583774.005155:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583774.005160:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005166:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfaa00/0x6d3e73d72c6e3a97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005182:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005188:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005194:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005206:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583774.005210:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005216:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005225:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b645246200) 00010000:00010000:2.0:1789583774.005228:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789583774.005231:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.005237:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3a89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583774.005789:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11523:x1876514313419776:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 20042us (20326us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789583774.005801:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 185 00000020:00080000:2.0:1789583774.005828:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789583774.007894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.008107:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313420288 00000100:00100000:0.0:1789583774.008120:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313420288 00000100:00100000:0.0:1789583774.008183:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583774.008195:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511e9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11523:x1876514313420288:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789583774.009160:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789583774.009279:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789583774.009353:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009374:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009389:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009399:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009406:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009413:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009441:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789583774.009566:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511e9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+22:11523:x1876514313420288:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1369us (1686us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789583774.009576:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000020:00080000:0.0:1789583774.009583:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789583774.009662:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583774.009671:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009679:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583774.009684:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009702:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009716:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.009720:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789583774.009726:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009732:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3a9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.009752:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583774.009754:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583774.009756:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583774.013986:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583774.014000:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583774.014524:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789583774.014535:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789583774.239641:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583774.239656:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583774.239705:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789583774.239713:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789583774.248355:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789583774.318794:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1789583774.318859:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789583774.318875:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:2.0:1789583774.365405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583774.365460:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313420544 00000100:00100000:3.0:1789583774.365475:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313420544 00000100:00100000:3.0:1789583774.365558:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 186 00000100:00100000:3.0:1789583774.365572:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+22:11534:x1876514313420544:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583774.365606:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583774.365651:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3aa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6690 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.365781:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.365798:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.365830:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583774.365842:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789583774.366602:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3aa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6690 expref: 25 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.366626:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6690 expref: 24 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.366635:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:3.0:1789583774.366638:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789583774.366642:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483a00, rc 0) 00000100:00100000:3.0:1789583774.366723:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11534:x1876514313420544:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1154us (1334us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789583774.366732:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 186 00000100:00100000:1.0:1789583774.371793:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583774.371918:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313420672 00000100:00100000:2.0:1789583774.371931:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313420672 00000100:00100000:2.0:1789583774.372006:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 187 00000100:00100000:2.0:1789583774.372018:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11534:x1876514313420672:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:2.0:1789583774.372128:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372149:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372163:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372181:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372188:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372193:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372754:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372766:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372776:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583774.372866:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.372883:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373044:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373055:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373063:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583774.373068:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373078:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373093:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:2.0:1789583774.373096:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583774.373102:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373109:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3aba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373125:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373131:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373138:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373144:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583774.373153:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373159:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373168:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b6583d4e00) 00010000:00010000:2.0:1789583774.373171:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583774.373174:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373180:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373197:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373204:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373210:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373304:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583774.373308:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373315:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373323:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b6583d4900) 00010000:00010000:2.0:1789583774.373326:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583774.373335:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583774.373341:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0e00/0x6d3e73d72c6e3ac8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583774.373466:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11534:x1876514313420672:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1446us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583774.373475:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 187 00000100:00100000:1.0:1789583774.420512:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.420868:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313420928 00000100:00100000:0.0:1789583774.420882:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313420928 00000100:00100000:0.0:1789583774.420962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 188 00000100:00100000:0.0:1789583774.420983:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11537:x1876514313420928:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583774.421013:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.421040:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3acf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6697 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421142:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421161:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421183:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421202:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421210:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421217:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421787:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421798:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.421888:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583774.421901:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789583774.422556:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422567:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422575:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422581:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752ca200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.422597:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422606:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422621:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583774.422625:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.422631:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422637:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3ad6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422650:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422657:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422663:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422669:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752ca400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.422672:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422677:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422685:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76100) 00010000:00010000:0.0:1789583774.422688:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.422698:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422704:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3add lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422774:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3acf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422791:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.422799:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.422801:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583774.423768:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cb000, rc 0) 00000100:00100000:0.0:1789583774.424101:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11537:x1876514313420928:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 3116us (3599us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789583774.424115:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 188 00000100:00100000:3.0:1789583774.429544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.429687:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313421056 00000100:00100000:0.0:1789583774.429699:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313421056 00000100:00100000:0.0:1789583774.429761:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 189 00000100:00100000:0.0:1789583774.429772:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11537:x1876514313421056:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789583774.429880:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.429911:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.429924:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430067:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430076:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430083:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430089:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cac00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.430093:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430101:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430115:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.430118:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789583774.430123:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.430130:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.430223:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11537:x1876514313421056:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 451us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.430231:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 189 00000100:00100000:1.0:1789583774.435183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583774.435728:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313421312 00000100:00100000:3.0:1789583774.435742:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313421312 00000100:00100000:3.0:1789583774.435842:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:3.0:1789583774.435854:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11537:x1876514313421312:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789583774.438458:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+27:11537:x1876514313421312:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 2588us (3266us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789583774.438475:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:2.0:1789583774.489717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.489840:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313421568 00000100:00100000:0.0:1789583774.489853:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313421568 00000100:00100000:0.0:1789583774.489924:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 190 00000100:00100000:0.0:1789583774.489954:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+27:11071:x1876514313421568:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583774.489988:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.490016:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec669e expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.490147:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.490167:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.490178:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.490219:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.490235:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 28 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.490252:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332285824:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583774.490390:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583774.495000:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba92d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332285824:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583774.495040:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583774.495110:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583774.495160:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313421696 00000100:00100000:3.0:1789583774.495170:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313421696 00010000:00010000:3.0:1789583774.495217:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 29 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583774.495268:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:3.0:1789583774.495280:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+29:2359:x1876514313421696:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583774.495309:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583774.495318:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 29 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.495332:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 29 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.495443:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3ae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6697 expref: 29 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.495463:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:3.0:1789583774.495468:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.495479:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.495516:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.495562:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583774.495632:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:2359:x1876514313421696:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 354us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583774.495774:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00010000:00010000:1.0:1789583774.495864:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.495948:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583774.495985:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789583774.496697:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cac00/0x6d3e73d72c6e3af9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 29 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.496725:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 28 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.496735:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:1.0:1789583774.496737:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789583774.496741:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca400, rc 0) 00000100:00100000:1.0:1789583774.496841:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+28:11071:x1876514313421568:12345-192.168.203.46@tcp:101:bash.0 Request processed in 6890us (7137us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789583774.496851:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 190 00000100:00100000:2.0:1789583774.502137:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583774.502220:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313421952 00000100:00100000:3.0:1789583774.502235:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313421952 00000100:00100000:3.0:1789583774.502318:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 191 00000100:00100000:3.0:1789583774.502332:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:11071:x1876514313421952:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:3.0:1789583774.502729:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.502752:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.502767:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583774.502873:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789583774.502908:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c2353e6 reply state 00000000f0628d00 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583774.502918:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789583774.503223:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789583774.503427:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11071:x1876514313421952:12345-192.168.203.46@tcp:36:bash.0 Request processed in 1096us (1304us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789583774.503436:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 191 00000020:00080000:3.0:1789583774.503442:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789583774.507286:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.507336:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.507346:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.507353:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.507358:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.507367:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.507387:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.507391:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.507397:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.507403:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3b0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583774.508200:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.508428:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313422080 00000100:00100000:0.0:1789583774.508441:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313422080 00000100:00100000:0.0:1789583774.508515:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:0.0:1789583774.508526:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+31:11071:x1876514313422080:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583774.508564:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.508587:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66a5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.508666:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66a5 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.508698:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66a5 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.508722:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.508725:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789583774.508728:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752ca200, rc 0) 00000100:00100000:0.0:1789583774.508801:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11071:x1876514313422080:12345-192.168.203.46@tcp:101:bash.0 Request processed in 277us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.508837:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 192 00000100:00100000:2.0:1789583774.512006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.512096:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313422208 00000100:00100000:0.0:1789583774.512110:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313422208 00000100:00100000:0.0:1789583774.512188:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:0.0:1789583774.512200:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+7:11071:x1876514313422208:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583774.512225:0:9665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.512256:0:9665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66ac expref: -99 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583774.512302:0:9665:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aaae19c, atime: 0x6aaae19b, ctime: 0x6aaae19c, blocks: 0xb 00010000:00010000:0.0:1789583774.512332:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1789583774.512337:0:9665:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583774.512347:0:9665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 8 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.512365:0:9665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 8 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.512405:0:9665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6752cac00, rc 0) 00000100:00100000:0.0:1789583774.512479:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+8:11071:x1876514313422208:12345-192.168.203.46@tcp:101:bash.0 Request processed in 281us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.512486:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789583774.515802:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583774.515973:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313422336 00000100:00100000:2.0:1789583774.515987:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313422336 00002000:00010000:2.0:1789583774.516042:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789583774.516048:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b5a4a80 with x1876514313422336 ext(0->18446744073709551615) 00002000:00010000:2.0:1789583774.516064:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b67b5a4a80. 00000100:00100000:2.0:1789583774.516093:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789583774.516104:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313422336:12345-192.168.203.46@tcp:10:bash.0 00002000:00010000:2.0:1789583774.516473:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789583774.516478:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789583772 -> 1789583774 00002000:00010000:2.0:1789583774.516481:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789583771 -> 1789583771 00002000:00010000:2.0:1789583774.516484:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789583772 -> 1789583774 00002000:00010000:2.0:1789583774.516486:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789583774.516618:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313422336:12345-192.168.203.46@tcp:10:bash.0 Request processed in 514us (830us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789583774.516647:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00002000:00010000:2.0:1789583774.516652:0:6710:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789583774.516655:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b5a4a80 with x1876514313422336 ext(0->18446744073709551615) 00002000:00010000:2.0:1789583774.516662:0:6710:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b67b5a4a80. 00000100:00100000:3.0:1789583774.598352:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583774.598718:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313422464 00000100:00100000:2.0:1789583774.598732:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313422464 00000100:00100000:2.0:1789583774.598952:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:0.0:1789583774.599044:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11551:x1876514313422464:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:0.0:1789583774.599144:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599165:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599179:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599194:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599202:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599208:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599508:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599519:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599540:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789583774.599603:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599617:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599623:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599631:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599638:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.599643:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599652:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599667:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583774.599670:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.599677:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599683:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599697:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599709:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599714:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599719:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.599723:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599729:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599737:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76000) 00010000:00010000:0.0:1789583774.599740:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.599743:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599748:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599768:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599775:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599781:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599786:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752caa00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.599795:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599801:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599876:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.599879:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.599883:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.599889:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.599998:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11551:x1876514313422464:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 1032us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.604014:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 193 00000100:00100000:1.0:1789583774.636620:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.636758:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313422720 00000100:00100000:0.0:1789583774.636774:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313422720 00000100:00100000:0.0:1789583774.636879:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:0.0:1789583774.636893:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+32:11554:x1876514313422720:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583774.636922:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.636951:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66b3 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637062:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637081:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637121:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637138:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637146:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637153:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637514:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637526:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637533:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583774.637545:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789583774.637665:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637674:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637681:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637688:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cbc00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.637699:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637708:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637722:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583774.637725:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.637730:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637737:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cbc00/0x6d3e73d72c6e3b3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637753:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637759:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637765:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637771:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cb000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.637773:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637780:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637788:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76000) 00010000:00010000:0.0:1789583774.637790:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.637800:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637869:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cb000/0x6d3e73d72c6e3b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637925:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752caa00/0x6d3e73d72c6e3b38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66b3 expref: 35 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637942:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66b3 expref: 34 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.637951:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.637954:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789583774.637956:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54e00, rc 0) 00000100:00100000:0.0:1789583774.638039:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11554:x1876514313422720:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1148us (1435us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789583774.638049:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 194 00000100:00100000:2.0:1789583774.641411:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583774.641523:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313422848 00000100:00100000:3.0:1789583774.641537:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313422848 00000100:00100000:3.0:1789583774.641654:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 195 00000100:00100000:3.0:1789583774.641667:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11554:x1876514313422848:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:3.0:1789583774.641754:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.641776:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 34 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.641786:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.641874:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 34 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.641896:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 34 pid: 8280 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583774.641913:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332285952:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583774.642018:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583774.645148:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5849:1876514332285952:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583774.645192:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583774.650449:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583774.650798:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313423104 00000100:00100000:3.0:1789583774.650996:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313423104 00000100:00100000:3.0:1789583774.651079:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:3.0:1789583774.651093:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+35:5597:x1876514313423104:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789583774.651529:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+36:5597:x1876514313423104:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 437us (1096us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789583774.651538:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:3.0:1789583774.654253:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.654358:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313423232 00000100:00100000:0.0:1789583774.654370:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313423232 00010000:00010000:0.0:1789583774.654426:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 36 pid: 8280 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.654474:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:0.0:1789583774.654491:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+36:2359:x1876514313423232:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583774.654511:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583774.654519:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 36 pid: 8280 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.654558:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 36 pid: 8280 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.654583:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca400/0x6d3e73d72c6e3b00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec669e expref: 36 pid: 8280 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.654611:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.654617:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.654629:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.654638:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.654676:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583774.654749:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:2359:x1876514313423232:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 260us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.654757:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00010000:00010000:1.0:1789583774.655215:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655226:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655262:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655271:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655296:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655303:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583774.655308:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655318:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655328:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:1.0:1789583774.655332:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583774.655339:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.655347:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583774.655459:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11554:x1876514313422848:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 13795us (14070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583774.655470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 195 00000100:00100000:3.0:1789583774.661636:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.661944:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313423488 00000100:00100000:0.0:1789583774.661957:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313423488 00000100:00100000:0.0:1789583774.662029:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:0.0:1789583774.662041:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+34:11554:x1876514313423488:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789583774.662373:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+35:11554:x1876514313423488:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 333us (752us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789583774.662382:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:2.0:1789583774.768949:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.769099:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313423744 00000100:00100000:0.0:1789583774.769113:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313423744 00000100:00100000:0.0:1789583774.769191:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 196 00000100:00100000:0.0:1789583774.769202:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+35:11565:x1876514313423744:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:0.0:1789583774.769233:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.769261:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66ba expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769367:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769385:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769400:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769415:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769422:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769429:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769781:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54400/0x6d3e73d72c6e3b77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769792:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54400/0x6d3e73d72c6e3b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.769852:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54400/0x6d3e73d72c6e3b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583774.769865:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789583774.769996:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770004:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770011:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770018:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.770023:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770032:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770047:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583774.770050:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.770056:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770062:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770077:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770083:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770100:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770105:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.770108:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770114:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770121:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76000) 00010000:00010000:0.0:1789583774.770124:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.770127:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770133:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770188:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ba expref: 38 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770204:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54400/0x6d3e73d72c6e3b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ba expref: 37 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.770212:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.770214:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583774.770217:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54400, rc 0) 00000100:00100000:0.0:1789583774.770320:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11565:x1876514313423744:12345-192.168.203.46@tcp:101:cat.0 Request processed in 1119us (1383us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789583774.770338:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 196 00000100:00100000:2.0:1789583774.779407:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.779573:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313424000 00000100:00100000:0.0:1789583774.779587:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313424000 00000100:00100000:0.0:1789583774.779677:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:0.0:1789583774.779690:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11565:x1876514313424000:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:0.0:1789583774.780307:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+38:11565:x1876514313424000:12345-192.168.203.46@tcp:35:cat.0 Request processed in 617us (931us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789583774.780316:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 54 00000100:00100000:3.0:1789583774.804077:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.804310:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313424256 00000100:00100000:0.0:1789583774.804323:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313424256 00000100:00100000:0.0:1789583774.804420:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 197 00000100:00100000:0.0:1789583774.804433:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+38:11566:x1876514313424256:12345-192.168.203.46@tcp:36:rm.0 00010000:00010000:0.0:1789583774.804511:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789583774.804546:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54400/0x6d3e73d72c6e3b77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ba expref: 38 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804576:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66b3 expref: 37 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804589:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca200/0x6d3e73d72c6e3b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66a5 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804614:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.804632:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583774.804660:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804695:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804707:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804725:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804733:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.804739:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.805318:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.805328:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.805336:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789583774.806879:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789583774.807298:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331791490620ns, next at 332791477418ns, rc = 0 00010000:00010000:0.0:1789583774.807489:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807508:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807536:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807546:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807553:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807559:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807706:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583774.807739:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807747:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807755:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807761:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.807767:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807776:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807789:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76300) 00010000:00010000:0.0:1789583774.807793:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789583774.807833:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807842:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3b93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807865:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807872:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807879:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807895:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.807898:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807904:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807913:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583774.807916:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.807919:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.807925:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3b85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789583774.807936:0:5850:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe3208fc reply state 00000000bd292df4 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.807968:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789583774.808108:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+37:11566:x1876514313424256:12345-192.168.203.46@tcp:36:rm.0 Request processed in 3671us (4040us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789583774.808118:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 197 00010000:00010000:3.0:1789583774.810468:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583774.810485:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.810510:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583774.810516:0:7652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.810528:0:7652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.810549:0:7652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff88b643e76300) 00010000:00010000:3.0:1789583774.810552:0:7652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789583774.810558:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.810571:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55400/0x6d3e73d72c6e3b9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583774.810599:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583774.810601:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583774.810603:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583774.811462:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.811479:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.811488:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.811493:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.811499:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.811506:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.811522:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76000) 00010000:00010000:0.0:1789583774.811525:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.811529:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.811536:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3b8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583774.850931:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.850983:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313424512 00000100:00100000:0.0:1789583774.850996:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313424512 00000100:00100000:0.0:1789583774.851090:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 198 00000100:00100000:0.0:1789583774.851103:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+36:11572:x1876514313424512:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583774.851138:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.851167:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3ba1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66c1 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.851339:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.851359:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.851373:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.851389:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.851850:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.851859:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789583774.854241:0:8280:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789583774.854728:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.854753:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.854769:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855531:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855545:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855553:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855560:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.855566:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855574:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855589:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583774.855593:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.855599:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855606:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3ba8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789583774.855624:0:8280:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009840a16a reply state 0000000008a81ce3 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.855634:0:8280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789583774.855683:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3ba1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 39 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855715:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 38 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.855723:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583774.855726:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583774.855728:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54e00, rc 0) 00000100:00100000:0.0:1789583774.855950:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+39:11572:x1876514313424512:12345-192.168.203.46@tcp:101:bash.0 Request processed in 4849us (5036us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789583774.855970:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 198 00010000:00010000:0.0:1789583774.863147:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.863169:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.863178:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.863185:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583774.863190:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.863199:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.863220:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76000) 00010000:00010000:0.0:1789583774.863223:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583774.863228:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.863252:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3baf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583774.866430:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.866847:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313424640 00000100:00100000:0.0:1789583774.866860:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313424640 00000100:00080000:2.0:1789583774.867556:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583774.868967:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:0.0:1789583774.868998:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313424640:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583774.869026:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583774.869055:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66c8 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583774.869091:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789583774.869125:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1789583774.869130:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583774.869142:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.869165:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.869181:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54a00, rc 0) 00000100:00100000:0.0:1789583774.869266:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313424640:12345-192.168.203.46@tcp:101:bash.0 Request processed in 283us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.869273:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:2.0:1789583774.874198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583774.878780:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313424768 00000100:00100000:1.0:1789583774.878800:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313424768 00000100:00100000:1.0:1789583774.879055:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:1.0:1789583774.879070:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:11572:x1876514313424768:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789583774.879097:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583774.879122:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66cf expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.879191:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.879201:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583774.879207:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583774.879213:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.879256:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.879271:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 7 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583774.879494:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b983480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1876514332286080:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583774.879716:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583774.887708:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.889166:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313424896 00000100:00100000:0.0:1789583774.889184:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313424896 00010000:00010000:0.0:1789583774.889266:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 8 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.889334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:0.0:1789583774.889352:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313424896:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583774.889372:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583774.889402:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 8 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.889418:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 8 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.889451:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583774.889456:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583774.889466:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.889478:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583774.889524:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583774.889541:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67ba92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1876514332286208:192.168.203.46@tcp:105: 00000100:00100000:0.0:1789583774.889899:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789583774.890486:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039aa42d5/0x6d3e73d72c6e3bc4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c8 expref: 8 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583774.890507:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b983480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1876514332286080:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583774.890547:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583774.890559:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfae00, rc 0) 00000100:00100000:1.0:1789583774.890716:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:11572:x1876514313424768:12345-192.168.203.46@tcp:101:bash.0 Request processed in 11648us (16532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583774.890725:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:2.0:1789583774.900500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583774.900758:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67ba92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5835:1876514332286208:192.168.203.46@tcp:105: 00010000:00010000:0.0:1789583774.900893:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583774.900959:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313424896:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 11614us (13267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583774.900972:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 75 00000100:00100000:3.0:1789583774.901320:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313425152 00000100:00100000:3.0:1789583774.901332:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313425152 00000100:00100000:3.0:1789583774.901455:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:3.0:1789583774.901465:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+38:11572:x1876514313425152:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:3.0:1789583774.907113:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+39:11572:x1876514313425152:12345-192.168.203.46@tcp:35:bash.0 Request processed in 5633us (6611us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789583774.907146:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 55 00000100:00100000:2.0:1789583775.071614:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.071744:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313425280 00000100:00100000:3.0:1789583775.071757:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313425280 00000100:00100000:3.0:1789583775.071879:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 199 00000100:00080000:2.0:1789583775.071973:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583775.072011:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+39:11588:x1876514313425280:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583775.072042:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583775.072071:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3bd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.072159:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3bd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.072176:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.072192:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583775.072236:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789583775.072240:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583775.072260:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.072306:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3bd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66d6 expref: 41 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.072331:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66d6 expref: 40 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.072363:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:3.0:1789583775.072367:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583775.072371:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483800, rc 0) 00000100:00100000:3.0:1789583775.072498:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11588:x1876514313425280:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 608us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.072506:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 199 00000100:00100000:0.0:1789583775.083801:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583775.084053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313425536 00000100:00100000:1.0:1789583775.084068:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313425536 00000100:00100000:1.0:1789583775.084144:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 200 00000100:00100000:1.0:1789583775.084156:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67ba92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+40:11588:x1876514313425536:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583775.084183:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583775.084211:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66dd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.084366:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3be7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.084385:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.084400:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583775.084413:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789583775.084575:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb600/0x6d3e73d72c6e3be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66dd expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.084600:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66dd expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.084610:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:1.0:1789583775.084613:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583775.084637:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfb200, rc 0) 00000100:00100000:1.0:1789583775.085021:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67ba92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+42:11588:x1876514313425536:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 866us (1232us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789583775.085030:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 200 00000100:00100000:2.0:1789583775.091353:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583775.091408:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.091488:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313425792 00000100:00100000:3.0:1789583775.091501:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313425792 00000100:00100000:0.0:1789583775.091643:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313425920 00000100:00100000:0.0:1789583775.091648:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313425920 00000100:00100000:0.0:1789583775.091716:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:0.0:1789583775.091728:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+43:2358:x1876514313425920:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583775.091749:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583775.091780:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb200/0x6d3e73d72c6e3be7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66dd expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.091801:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583775.091851:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583775.091926:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+42:2358:x1876514313425920:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 200us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.091934:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:3.0:1789583775.092389:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 201 00000100:00100000:3.0:1789583775.092400:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+41:11588:x1876514313425792:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583775.092426:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583775.092447:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3bf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66e4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.092569:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3bfc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.092585:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3bfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.092609:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3bfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583775.092625:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789583775.092798:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3bf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66e4 expref: 44 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.092861:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3bfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66e4 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.092870:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:3.0:1789583775.092872:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789583775.092876:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483c00, rc 0) 00000100:00100000:3.0:1789583775.092943:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+43:11588:x1876514313425792:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 545us (1532us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789583775.092950:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 201 00000100:00100000:2.0:1789583775.101174:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.101293:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313426048 00000100:00100000:0.0:1789583775.101306:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313426048 00000100:00100000:0.0:1789583775.101383:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:0.0:1789583775.101396:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+6:2359:x1876514313426048:12345-192.168.203.46@tcp:1:lfs.0 00010000:00010000:0.0:1789583775.101459:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.101486:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.101514:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789583775.101520:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789583775.101526:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.101583:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.101601:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 6 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.101619:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b199180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1876514332286336:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583775.104153:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1789583775.109716:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583775.110171:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313426176 00000100:00100000:1.0:1789583775.110185:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313426176 00002000:00100000:1.0:1789583775.110249:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88b67b199500 x1876514313426176/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:491/0 lens 504/0 e 0 to 0 dl 1789583786 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789583775.110262:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b199500 with x1876514313426176 ext(0->8) 00010000:00010000:1.0:1789583775.110275:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 7 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.110307:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 7 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583775.110316:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88b67b199500 00000100:00100000:1.0:1789583775.110355:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:1.0:1789583775.110364:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313426176:12345-192.168.203.46@tcp:4:lfs.0 00000100:00100000:1.0:1789583775.111087:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2358:x1876514313426176:12345-192.168.203.46@tcp:4:lfs.0 Request processed in 718us (1390us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789583775.111096:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00002000:00100000:1.0:1789583775.111105:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff88b67b199500 x1876514313426176/t4294967308(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:491/0 lens 504/448 e 0 to 0 dl 1789583786 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789583775.111115:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b199500 with x1876514313426176 ext(0->8) 00010000:00010000:1.0:1789583775.111122:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 9 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.111144:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 9 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583775.111152:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88b67b199500 00000100:00100000:2.0:1789583775.113920:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b199180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6702:1876514332286336:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583775.113964:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583775.117929:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.118058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313426304 00000100:00100000:3.0:1789583775.118072:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313426304 00010000:00010000:3.0:1789583775.118124:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 9 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583775.118173:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:3.0:1789583775.118185:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b983480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2359:x1876514313426304:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583775.118206:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789583775.118232:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789583775.118236:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789583774 00002000:00010000:3.0:1789583775.118238:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789583774 00002000:00010000:3.0:1789583775.118240:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789583774 00010000:00010000:3.0:1789583775.118248:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 9 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.118264:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 9 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.118326:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008181cfb0/0x6d3e73d72c6e3bcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66cf expref: 9 pid: 6705 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.118349:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583775.118355:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583775.118362:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.118373:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.118412:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583775.118483:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b983480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313426304:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 299us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.118492:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00010000:00010000:2.0:1789583775.118845:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118865:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118896:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118905:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118913:0:6702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118920:0:6702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583775.118925:0:6702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118933:0:6702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118945:0:6702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.118952:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c828450f/0x6d3e73d72c6e3c0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583775.119038:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313426048:12345-192.168.203.46@tcp:1:lfs.0 Request processed in 17644us (17876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583775.119048:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:1.0:1789583775.130106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.130247:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313426560 00000100:00100000:0.0:1789583775.130262:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313426560 00000100:00100000:0.0:1789583775.130410:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 56 00000100:00100000:0.0:1789583775.130423:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+43:11588:x1876514313426560:12345-192.168.203.46@tcp:35:lfs.0 00000004:00010000:0.0:1789583775.130527:0:5851:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3bfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66e4 expref: 43 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789583775.131024:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1789583775.131076:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789583775.131461:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789583775.131524:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.131559:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 47 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.131569:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.131779:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 47 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.131799:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 47 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.131846:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b19aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332286464:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583775.132081:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583775.134974:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b19aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5851:1876514332286464:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583775.135015:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583775.136352:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.136929:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313426688 00000100:00100000:0.0:1789583775.136943:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313426688 00010000:00010000:0.0:1789583775.136994:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 48 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.137042:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:0.0:1789583775.137054:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+48:2359:x1876514313426688:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583775.137077:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583775.137104:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 48 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.137119:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 48 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.137147:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3bb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66c1 expref: 48 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.137166:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583775.137172:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.137184:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.137194:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.137680:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583775.137764:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b983100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+47:2359:x1876514313426688:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 709us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.137774:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 77 00010000:00010000:1.0:1789583775.139228:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.139247:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583775.139566:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789583775.140029:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1789583775.140171:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b982680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332286592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789583775.140261:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583775.140373:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583775.140683:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332286592 00000100:00100000:0.0:1789583775.140693:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332286592 00000100:00100000:0.0:1789583775.140875:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583775.140896:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332286592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789583775.141072:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332286592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 179us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.141101:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789583775.143956:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583775.144685:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789583775.144695:0:5851:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789583775.144723:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b67508b800, transno 4294967307 00000100:00100000:3.0:1789583775.144976:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b982680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332286592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789583775.147551:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789583775.148236:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332286720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789583775.148342:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583775.148461:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68540 going to sleep for 11 seconds 00000100:00100000:3.0:1789583775.149135:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332286720 00000100:00100000:3.0:1789583775.149146:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332286720 00000100:00100000:2.0:1789583775.149307:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789583775.149318:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1876514332286720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789583775.149788:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1876514332286720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 471us (1445us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789583775.149798:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789583775.150073:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5851:1876514332286720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789583775.150277:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1789583775.153302:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.153323:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.153332:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.153338:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583775.153344:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.153354:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.153375:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583775.153378:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789583775.153384:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.153391:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c11 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789583775.153704:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789583775.155048:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789583775.155073:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332139266247ns, next at 333139261265ns, rc = 0 00000001:00080000:0.0:1789583775.155089:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789583775.155681:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76a00) 00010000:00010000:0.0:1789583775.155706:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789583775.155720:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3bfc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66e4 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.155981:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+50:11588:x1876514313426560:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 25559us (25887us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789583775.155993:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 56 00000020:00080000:0.0:1789583775.156000:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789583775.159264:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.169319:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313426816 00000100:00100000:0.0:1789583775.169339:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313426816 00000100:00100000:0.0:1789583775.169426:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:0.0:1789583775.169438:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+50:11588:x1876514313426816:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583775.169475:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583775.169517:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66eb expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.169601:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66eb expref: 51 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.169621:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66eb expref: 51 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.169648:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.169652:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789583775.169656:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54c00, rc 0) 00000100:00100000:0.0:1789583775.169756:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b980e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+51:11588:x1876514313426816:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 320us (10508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.169764:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 202 00000100:00100000:2.0:1789583775.184913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.185091:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313427072 00000100:00100000:3.0:1789583775.185105:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313427072 00000100:00100000:3.0:1789583775.185183:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:3.0:1789583775.185215:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+51:11588:x1876514313427072:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789583775.185564:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11588:x1876514313427072:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 352us (664us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789583775.185572:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 57 00000100:00100000:3.0:1789583775.267978:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583775.268235:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313427200 00000100:00100000:1.0:1789583775.268249:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313427200 00000100:00100000:1.0:1789583775.268327:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 203 00000100:00100000:1.0:1789583775.268339:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11598:x1876514313427200:12345-192.168.203.46@tcp:34:lfs.0 00010000:00010000:1.0:1789583775.268440:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268461:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268505:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268522:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268529:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268535:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268648:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268658:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268665:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789583775.268719:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268746:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268755:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268763:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268779:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583775.268784:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268793:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268845:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:1.0:1789583775.268849:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583775.268855:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.268861:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269058:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269067:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269073:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269078:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583775.269081:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269087:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269107:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b660567700) 00010000:00010000:1.0:1789583775.269110:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583775.269113:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269119:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269137:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269142:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269147:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269152:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583775.269155:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269160:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269167:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583775.269169:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583775.269172:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.269177:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfba00/0x6d3e73d72c6e3c2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583775.269296:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11598:x1876514313427200:12345-192.168.203.46@tcp:34:lfs.0 Request processed in 957us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583775.269306:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 203 00010000:00010000:0.0:1789583775.271515:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583775.271865:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332287232:0@lo:400:kworker.0 00000100:00100000:2.0:1789583775.271957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583775.272028:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789583775.272035:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332287104:0@lo:400:kworker.0 00000100:00100000:2.0:1789583775.272063:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583775.272098:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332287232 00000100:00100000:2.0:1789583775.272108:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332287232 00000100:00100000:2.0:1789583775.272169:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789583775.272180:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332287232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583775.272371:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332286976:0@lo:400:kworker.0 00000100:00100000:3.0:1789583775.272406:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583775.272429:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789583775.272434:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332286848:0@lo:400:kworker.0 00000100:00100000:3.0:1789583775.272463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583775.272503:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332287360:0@lo:400:kworker.0 00000100:00100000:3.0:1789583775.272526:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583775.272583:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332287488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583775.272610:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789583775.272654:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583775.272672:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332287488 00000100:00100000:3.0:1789583775.272676:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332287488 00000100:00100000:3.0:1789583775.272706:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789583775.272713:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876514332287488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583775.272748:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583775.272797:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876514332287488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.272803:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789583775.272871:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332287488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583775.273174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332286848 00000100:00100000:1.0:1789583775.273180:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332286848 00000100:00100000:1.0:1789583775.273342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789583775.273351:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3308:x1876514332286848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583775.273399:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3308:x1876514332286848:12345-0@lo:400:kworker.0 Request processed in 51us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583775.273406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789583775.273445:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332286848:0@lo:400:kworker.0 00000100:00100000:1.0:1789583775.273477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332287104 00000100:00100000:0.0:1789583775.273828:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332286976 00000100:00100000:0.0:1789583775.273834:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332286976 00000100:00100000:0.0:1789583775.273871:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332287360 00000100:00100000:0.0:1789583775.273874:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332287360 00000100:00100000:3.0:1789583775.273958:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789583775.273979:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332286976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583775.274025:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332286976:12345-0@lo:400:kworker.0 Request processed in 47us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.274031:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789583775.274084:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332286976:0@lo:400:kworker.0 00000100:00100000:1.0:1789583775.274143:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332287104 00000100:00100000:1.0:1789583775.274173:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789583775.274179:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332287104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583775.274295:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789583775.274303:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332287360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583775.274338:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332287360:12345-0@lo:400:kworker.0 Request processed in 37us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.274344:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789583775.274600:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332287232:12345-0@lo:400:kworker.0 Request processed in 2411us (2632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583775.274617:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789583775.274659:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332287232:0@lo:400:kworker.0 00000100:00100000:1.0:1789583775.274728:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332287104:12345-0@lo:400:kworker.0 Request processed in 548us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583775.274742:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789583775.274969:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583775.274992:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332287360:0@lo:400:kworker.0 00000100:00100000:2.0:1789583775.275130:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332287104:0@lo:400:kworker.0 00000100:00100000:1.0:1789583775.325290:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.326011:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313427456 00000100:00100000:0.0:1789583775.326028:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313427456 00000100:00100000:0.0:1789583775.326117:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:0.0:1789583775.326129:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+52:11601:x1876514313427456:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583775.326154:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583775.326183:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66f2 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326306:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326324:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326340:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326356:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326389:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326412:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326569:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326577:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.326585:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583775.327756:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789583775.328015:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328027:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328035:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328042:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583775.328047:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328056:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328096:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583775.328100:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583775.328106:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328113:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55000/0x6d3e73d72c6e3c3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328132:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328139:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328145:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328151:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54000 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583775.328154:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328159:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328166:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b643e76a00) 00010000:00010000:0.0:1789583775.328168:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583775.328171:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328176:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328254:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 55 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328272:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 54 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.328279:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.328290:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583775.328294:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54600, rc 0) 00000100:00100000:0.0:1789583775.328402:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+54:11601:x1876514313427456:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 2274us (3135us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789583775.328413:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 204 00000100:00100000:2.0:1789583775.337574:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.337678:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313427584 00000100:00100000:0.0:1789583775.337690:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313427584 00000100:00100000:0.0:1789583775.337767:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 205 00000100:00100000:0.0:1789583775.337779:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:11601:x1876514313427584:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789583775.337920:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.337943:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.337958:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.337991:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.338022:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.338031:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.338037:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583775.338042:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.338051:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.338064:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.338068:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789583775.338075:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.338084:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.338173:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+54:11601:x1876514313427584:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 396us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.338182:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 205 00000100:00100000:2.0:1789583775.342243:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.342402:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313427840 00000100:00100000:0.0:1789583775.342416:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313427840 00000100:00100000:0.0:1789583775.342490:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:0.0:1789583775.342502:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+54:11601:x1876514313427840:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:0.0:1789583775.342869:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11601:x1876514313427840:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 368us (639us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789583775.343076:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 58 00000100:00100000:2.0:1789583775.429726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.429864:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313428096 00000100:00100000:0.0:1789583775.429888:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313428096 00000100:00100000:0.0:1789583775.429967:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 206 00000100:00100000:0.0:1789583775.429979:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11611:x1876514313428096:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:0.0:1789583775.430013:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583775.430024:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789583775.430061:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3bd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66d6 expref: 55 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.430086:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583775.430092:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583775.430109:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec66f9 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.430266:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.430291:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 55 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.430300:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.430344:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 55 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.430361:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 55 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.430387:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b19aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332287616:192.168.203.46@tcp:104: 00000100:00100000:0.0:1789583775.430741:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583775.442006:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583775.442170:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b19aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332287616:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583775.442208:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.442710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313428224 00000100:00100000:0.0:1789583775.442720:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313428224 00010000:00010000:0.0:1789583775.442768:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 56 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.442842:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:0.0:1789583775.442853:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+56:2358:x1876514313428224:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583775.442872:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583775.442879:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 56 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.442893:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 56 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.442919:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f2 expref: 56 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.442937:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.442943:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.442954:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.442986:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.443191:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583775.443308:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+55:2358:x1876514313428224:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 456us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.443317:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00010000:00010000:2.0:1789583775.444129:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.444143:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583775.444170:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789583775.444395:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3c5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 56 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.444423:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 55 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.444432:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:2.0:1789583775.444434:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789583775.444438:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54000, rc 0) 00000100:00100000:2.0:1789583775.444485:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11611:x1876514313428096:12345-192.168.203.46@tcp:101:bash.0 Request processed in 14508us (14774us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789583775.444494:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 206 00000100:00100000:2.0:1789583775.457324:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.457455:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313428480 00000100:00100000:0.0:1789583775.457469:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313428480 00000100:00100000:0.0:1789583775.457547:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 207 00000100:00100000:0.0:1789583775.457559:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+55:11611:x1876514313428480:12345-192.168.203.46@tcp:36:bash.0 00010000:00010000:0.0:1789583775.457945:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.457980:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.457995:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789583775.458089:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1789583775.458116:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a52e762c reply state 000000008267c5e2 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.458127:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789583775.458239:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11611:x1876514313428480:12345-192.168.203.46@tcp:36:bash.0 Request processed in 681us (929us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789583775.458247:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 207 00000020:00080000:0.0:1789583775.458253:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789583775.467795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:0.0:1789583775.467921:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.467934:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.467941:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.467948:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583775.467953:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.467960:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.467976:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.467979:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583775.467984:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.467990:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583775.468113:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313428608 00000100:00100000:3.0:1789583775.468123:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313428608 00000100:00100000:3.0:1789583775.468233:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 208 00000100:00100000:3.0:1789583775.468244:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11611:x1876514313428608:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:3.0:1789583775.468267:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583775.468301:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3c7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6700 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.468389:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.468403:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 58 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.468412:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.468443:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 58 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.468477:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 58 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583775.468491:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332287744:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583775.468577:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64543a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583775.471419:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.471569:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332287744:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583775.471596:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.476663:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313428736 00000100:00100000:0.0:1789583775.476679:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313428736 00010000:00010000:0.0:1789583775.476728:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 59 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.476779:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:0.0:1789583775.476790:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+59:2359:x1876514313428736:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583775.476822:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583775.476844:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 59 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.476859:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 59 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.476881:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66f9 expref: 59 pid: 8280 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.476896:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.476902:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.476912:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.476920:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.476953:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583775.477025:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+58:2359:x1876514313428736:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 236us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.477038:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00010000:00010000:3.0:1789583775.477052:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.477071:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583775.477136:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789583775.477141:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583775.477177:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.477305:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3c7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.477330:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.477339:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583775.477356:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583775.477360:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483800, rc 0) 00000100:00100000:3.0:1789583775.477417:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b980700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11611:x1876514313428608:12345-192.168.203.46@tcp:101:bash.0 Request processed in 9174us (9631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.477426:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 208 00000100:00100000:0.0:1789583775.490694:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.490856:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313428992 00000100:00100000:3.0:1789583775.490866:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313428992 00000100:00100000:3.0:1789583775.490930:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:3.0:1789583775.490942:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+57:11611:x1876514313428992:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:3.0:1789583775.491394:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b19aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11611:x1876514313428992:12345-192.168.203.46@tcp:35:bash.0 Request processed in 453us (707us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789583775.491403:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 59 00000100:00100000:1.0:1789583775.595075:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.595197:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313429120 00000100:00100000:0.0:1789583775.595208:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313429120 00000100:00100000:0.0:1789583775.595308:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 209 00000100:00100000:0.0:1789583775.595319:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+58:11617:x1876514313429120:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583775.595343:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583775.595370:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6707 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.595432:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.595446:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.595458:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583775.595501:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789583775.595505:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583775.595521:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.595546:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3c88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6707 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.595569:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6707 expref: 59 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.595578:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583775.595581:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583775.595584:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54600, rc 0) 00000100:00100000:0.0:1789583775.595647:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313429120:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 330us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.595654:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 209 00000100:00100000:2.0:1789583775.600323:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.600416:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313429248 00000100:00100000:3.0:1789583775.600430:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313429248 00000100:00100000:3.0:1789583775.600501:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 210 00000100:00100000:3.0:1789583775.600516:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313429248:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583775.600537:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583775.600561:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3c96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec670e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600624:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600639:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600651:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600694:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600703:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600711:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600829:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600838:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.600846:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583775.601176:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789583775.601181:0:5850:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583775.601199:0:5850:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601211:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601219:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601226:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601243:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601249:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583775.601253:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601261:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601273:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:3.0:1789583775.601276:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583775.601291:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601298:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601312:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601319:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601325:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601330:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583775.601333:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601348:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601355:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b64336ab00) 00010000:00010000:3.0:1789583775.601358:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583775.601361:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601367:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601400:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3c96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec670e expref: 61 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601413:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec670e expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.601419:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583775.601422:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583775.601424:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483200, rc 0) 00000100:00100000:3.0:1789583775.601484:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11617:x1876514313429248:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 973us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.601491:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 210 00000100:00100000:2.0:1789583775.605328:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.605543:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313429376 00000100:00100000:3.0:1789583775.605553:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313429376 00000100:00100000:3.0:1789583775.605609:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583775.605618:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+60:2359:x1876514313429376:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583775.605659:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583775.606450:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec670e expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583775.606471:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583775.606476:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583775.606533:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+59:2359:x1876514313429376:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 915us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.606540:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583775.611173:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583775.612225:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313429632 00000100:00100000:1.0:1789583775.612236:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313429632 00000100:00100000:1.0:1789583775.612305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:1.0:1789583775.612315:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313429632:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583775.612333:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583775.612354:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3cb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6715 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.612449:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.612464:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.612472:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.612504:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 60 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.612518:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 60 pid: 5850 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583775.612532:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b982a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332287872:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583775.612631:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583775.620690:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.620863:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313429760 00000100:00100000:0.0:1789583775.620908:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313429760 00010000:00010000:0.0:1789583775.620962:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 61 pid: 5850 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583775.621013:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:0.0:1789583775.621025:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+61:2358:x1876514313429760:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583775.621044:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583775.621053:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 61 pid: 5850 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.621070:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 61 pid: 5850 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.621098:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.621105:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.621116:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.621124:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.621150:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583775.621218:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+61:2358:x1876514313429760:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 195us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.621226:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 80 00010000:00010000:1.0:1789583775.623161:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e3c81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6700 expref: 60 pid: 5850 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583775.623188:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b982a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332287872:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583775.623226:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.623235:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.623242:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583775.623262:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789583775.623424:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa200/0x6d3e73d72c6e3cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.623440:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583775.623449:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583775.623452:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789583775.623455:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa400, rc 0) 00000100:00100000:1.0:1789583775.623521:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11617:x1876514313429632:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 11208us (12595us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789583775.623530:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 211 00000100:00100000:2.0:1789583775.630516:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.632078:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430016 00000100:00100000:0.0:1789583775.632098:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430016 00000100:00100000:2.0:1789583775.632307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789583775.632319:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11617:x1876514313430016:12345-192.168.203.46@tcp:103:lfs.0 00010000:00010000:2.0:1789583775.632342:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583775.632378:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54c00/0x6d3e73d72c6e3c18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66eb expref: 60 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.632403:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:2.0:1789583775.632410:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583775.632496:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313430016:12345-192.168.203.46@tcp:103:lfs.0 Request processed in 180us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583775.632504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:2.0:1789583775.635209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583775.636195:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430144 00000100:00100000:3.0:1789583775.636210:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430144 00000100:00100000:2.0:1789583775.636628:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:2.0:1789583775.636642:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313430144:12345-192.168.203.46@tcp:58:lfs.0 00010000:00010000:2.0:1789583775.636779:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.636803:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583775.640832:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583775.641250:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789583775.641416:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313430144:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 4768us (6212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583775.641428:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 212 00000100:00100000:1.0:1789583775.652292:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583775.652425:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430272 00000100:00100000:0.0:1789583775.652438:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430272 00000100:00100000:0.0:1789583775.652548:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:0.0:1789583775.652557:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+59:11617:x1876514313430272:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583775.652582:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583775.652613:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec671c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.652786:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.652797:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.652904:0:5849:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.652920:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.652938:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583775.652941:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789583775.652946:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583775.652953:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54000, rc 0) 00000100:00100000:0.0:1789583775.653064:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11617:x1876514313430272:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 506us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583775.653072:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 213 00000100:00100000:1.0:1789583775.786549:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332288000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583775.787236:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583775.789118:0:12442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332288000 00000100:00100000:3.0:1789583775.789138:0:12442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332288000 00000100:00100000:3.0:1789583775.789222:0:12442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789583775.789235:0:12442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332288000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583775.789269:0:12442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583775.789380:0:12442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b983480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332288000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (2264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583775.789389:0:12442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789583775.789464:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332288000:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1789583776.040026:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583776.040035:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583776.040080:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:1.0:1789583776.040086:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789583776.040272:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b983100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332288128:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789583776.040429:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583776.047989:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.048093:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b983100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332288128:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789583776.048322:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430400 00000100:00100000:3.0:1789583776.048329:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430400 00000100:00100000:3.0:1789583776.048385:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 214 00000100:00100000:3.0:1789583776.048395:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11618:x1876514313430400:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789583776.048425:0:8280:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789583776.048526:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11618:x1876514313430400:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 132us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.048546:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 214 00000100:00100000:2.0:1789583776.055341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583776.055515:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430528 00000100:00100000:0.0:1789583776.055525:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430528 00000100:00100000:0.0:1789583776.055616:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 215 00000100:00100000:0.0:1789583776.055628:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11618:x1876514313430528:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789583776.055700:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055718:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055735:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055792:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055800:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055832:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055857:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055865:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055871:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583776.055907:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789583776.055924:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583776.055938:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055948:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055955:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055962:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055969:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.055973:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055981:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.055992:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:0.0:1789583776.055995:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583776.055999:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056005:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e3cd5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056018:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056023:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056040:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056045:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.056048:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056055:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056062:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff88b643e76a00) 00010000:00010000:0.0:1789583776.056065:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583776.056067:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056072:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3cdc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056089:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056095:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056100:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056105:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.056108:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056123:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056132:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583776.056134:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583776.056138:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.056143:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583776.056226:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11618:x1876514313430528:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 601us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583776.056234:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 215 00000100:00100000:0.0:1789583776.058704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.058798:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430784 00000100:00100000:3.0:1789583776.058851:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430784 00000100:00100000:3.0:1789583776.058916:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 216 00000100:00100000:3.0:1789583776.058926:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+60:11618:x1876514313430784:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583776.058946:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583776.058964:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6723 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059059:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059073:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059084:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583776.059095:0:8280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789583776.059212:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059221:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059228:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059234:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583776.059238:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059261:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059274:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583776.059288:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789583776.059294:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059300:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3cf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059345:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cea lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6723 expref: 62 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059361:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:3.0:1789583776.059363:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583776.059367:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3cea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6723 expref: 62 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.059378:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483200, rc 0) 00000100:00100000:3.0:1789583776.059449:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11618:x1876514313430784:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 523us (753us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1789583776.059679:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 216 00000100:00100000:1.0:1789583776.064032:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.065387:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313430912 00000100:00100000:2.0:1789583776.065398:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313430912 00000100:00100000:2.0:1789583776.065573:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 217 00000100:00100000:2.0:1789583776.065586:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11618:x1876514313430912:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789583776.065626:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789583776.065746:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11618:x1876514313430912:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 164us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.066045:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 217 00000100:00100000:0.0:1789583776.073077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.073142:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313431168 00000100:00100000:3.0:1789583776.073153:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313431168 00000100:00100000:3.0:1789583776.073210:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 218 00000100:00100000:3.0:1789583776.073220:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11618:x1876514313431168:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583776.073256:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583776.073259:0:8280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789583776.073297:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54600/0x6d3e73d72c6e3c8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6707 expref: 61 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.073315:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:3.0:1789583776.073320:0:8280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583776.073332:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3cff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec672a expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789583776.073734:0:8280:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1789583776.074154:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3d06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.074168:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.074179:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3d06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.074228:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3cff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec672a expref: 63 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.074245:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3d06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec672a expref: 62 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.074253:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336ab00) 00010000:00010000:3.0:1789583776.074256:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789583776.074267:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483200, rc 0) 00000100:00100000:3.0:1789583776.074340:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11618:x1876514313431168:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1121us (1271us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789583776.074347:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 218 00000100:00100000:3.0:1789583776.082712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583776.082970:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313431424 00000100:00100000:0.0:1789583776.082979:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313431424 00000100:00100000:0.0:1789583776.083042:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 219 00000100:00100000:0.0:1789583776.083052:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11618:x1876514313431424:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789583776.083110:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583776.083137:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483200/0x6d3e73d72c6e3d06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec672a expref: 62 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.083157:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336ab00) 00010000:00010000:0.0:1789583776.083170:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583776.083190:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.083350:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.083362:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.083400:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.083408:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084029:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084093:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084100:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084107:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084113:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.084117:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084123:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084131:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583776.084142:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583776.084147:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084153:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e3d14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084162:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084167:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084172:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084176:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.084178:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084183:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084189:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf5148f61 (ffff88b643e76a00) 00010000:00010000:0.0:1789583776.084191:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583776.084193:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.084198:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54800/0x6d3e73d72c6e3d1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf5148f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583776.084300:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11618:x1876514313431424:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 1248us (1595us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789583776.084314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 219 00000100:00100000:1.0:1789583776.093890:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.096108:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313431552 00000100:00100000:3.0:1789583776.096122:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313431552 00000100:00100000:3.0:1789583776.096237:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:3.0:1789583776.096247:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+61:11618:x1876514313431552:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583776.096265:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583776.096298:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6731 expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.096333:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.096346:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.096356:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.096453:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 63 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.096473:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 62 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.096482:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:3.0:1789583776.096490:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789583776.096494:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482200, rc 0) 00000100:00100000:3.0:1789583776.096559:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11618:x1876514313431552:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 314us (2689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.096566:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 220 00000100:00100000:2.0:1789583776.109460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583776.109553:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313431808 00000100:00100000:1.0:1789583776.109563:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313431808 00000100:00100000:1.0:1789583776.109621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 221 00000100:00100000:1.0:1789583776.109630:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+62:11618:x1876514313431808:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789583776.109708:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.109724:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.109745:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583776.110142:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1789583776.110151:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333094345133ns, next at 334094342977ns, rc = 0 00000004:00010000:1.0:1789583776.110319:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5edcae1 reply state 00000000deec77d7 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.110329:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789583776.110430:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+64:11618:x1876514313431808:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 800us (977us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789583776.110438:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 221 00010000:00010000:2.0:1789583776.116188:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.116216:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.116225:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.116232:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfae00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583776.116236:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.116258:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.116287:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:2.0:1789583776.116291:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789583776.116297:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.116303:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfae00/0x6d3e73d72c6e3d30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.116647:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.116909:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313431936 00000100:00100000:3.0:1789583776.116918:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313431936 00000100:00100000:3.0:1789583776.116981:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:3.0:1789583776.116991:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+63:11618:x1876514313431936:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583776.117016:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583776.117034:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6738 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.117092:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.117107:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.117125:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:3.0:1789583776.117128:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583776.117131:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482e00, rc 0) 00000100:00100000:3.0:1789583776.117196:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+64:11618:x1876514313431936:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 206us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.118924:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 222 00000100:00100000:0.0:1789583776.122637:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.122892:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313432064 00000100:00100000:2.0:1789583776.122902:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313432064 00000100:00100000:2.0:1789583776.123151:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:2.0:1789583776.123163:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2360:x1876514313432064:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789583776.124319:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583776.124615:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2360:x1876514313432064:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 1450us (1982us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789583776.124625:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:1.0:1789583776.138980:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583776.139150:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313432320 00000100:00100000:0.0:1789583776.139159:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313432320 00000100:00100000:0.0:1789583776.139224:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:0.0:1789583776.139236:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+64:11618:x1876514313432320:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789583776.139475:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+65:11618:x1876514313432320:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 241us (513us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789583776.139483:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 60 00000100:00100000:0.0:1789583776.141358:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.141440:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313432576 00000100:00100000:3.0:1789583776.141460:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313432576 00000100:00100000:3.0:1789583776.141511:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 223 00000100:00100000:3.0:1789583776.141521:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+65:11618:x1876514313432576:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789583776.141621:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+65:11618:x1876514313432576:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 102us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.141628:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 223 00000100:00100000:1.0:1789583776.146898:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.147005:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313432704 00000100:00100000:2.0:1789583776.147016:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313432704 00000100:00100000:2.0:1789583776.147079:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 224 00000100:00100000:2.0:1789583776.147095:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+65:11618:x1876514313432704:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583776.147117:0:8280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583776.147137:0:8280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec673f expref: -99 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.147350:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3d45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.147363:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.147374:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583776.147409:0:8280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583776.147426:0:8280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3d45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.147450:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec673f expref: 67 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.147468:0:8280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3d45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec673f expref: 66 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.147476:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:2.0:1789583776.147478:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789583776.147482:0:8280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0a00, rc 0) 00000100:00100000:2.0:1789583776.147541:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+66:11618:x1876514313432704:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 450us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.147548:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 224 00000100:00100000:2.0:1789583776.156545:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583776.156628:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313432832 00000100:00100000:1.0:1789583776.156638:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313432832 00000100:00100000:1.0:1789583776.156693:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:1.0:1789583776.156704:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67528d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+10:2359:x1876514313432832:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583776.156723:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583776.156898:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6746 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583776.156926:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaae19f, blocks: 0x1 00010000:00010000:1.0:1789583776.157053:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1789583776.157058:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583776.157068:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.157181:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 11 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.157195:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfbc00, rc 0) 00000100:00100000:1.0:1789583776.157324:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67528d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+11:2359:x1876514313432832:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 621us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583776.157332:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:0.0:1789583776.164930:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.165329:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433088 00000100:00100000:3.0:1789583776.165340:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433088 00000100:00100000:3.0:1789583776.165401:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 225 00000100:00100000:3.0:1789583776.165412:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+66:11618:x1876514313433088:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789583776.165517:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+66:11618:x1876514313433088:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 107us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.165524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 225 00000100:00100000:0.0:1789583776.170045:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.170204:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433216 00000100:00100000:2.0:1789583776.170215:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433216 00000100:00100000:2.0:1789583776.170288:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:2.0:1789583776.170298:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67508b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+11:11618:x1876514313433216:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583776.170314:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583776.170335:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec674d expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.170367:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.170376:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583776.170380:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583776.170385:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.170419:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.170434:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.170450:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1876514332288256:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583776.170545:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583776.174472:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1876514332288256:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583776.174510:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 12 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.174533:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0400, rc 0) 00000100:00100000:0.0:1789583776.174613:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67508b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+12:11618:x1876514313433216:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 4315us (4576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583776.174622:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:1.0:1789583776.175437:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.175528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433344 00000100:00100000:3.0:1789583776.175543:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433344 00010000:00010000:3.0:1789583776.175608:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583776.175659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:3.0:1789583776.175670:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+12:2358:x1876514313433344:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583776.175690:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583776.175722:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.175737:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.175787:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e3d4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6746 expref: 12 pid: 6705 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.175866:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583776.175878:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583776.175887:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.175900:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.175949:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 11 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583776.175965:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5833:1876514332288384:192.168.203.46@tcp:105: 00000100:00100000:3.0:1789583776.176069:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64543a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583776.185047:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.185229:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5833:1876514332288384:192.168.203.46@tcp:105: 00010000:00010000:3.0:1789583776.185292:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583776.185369:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+11:2358:x1876514313433344:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 9699us (9933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.185382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:2.0:1789583776.185787:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433472 00000100:00100000:2.0:1789583776.185798:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433472 00002000:00100000:2.0:1789583776.185925:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88b67c5f3800 x1876514313433472/t0(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:492/0 lens 504/0 e 0 to 0 dl 1789583787 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789583776.185953:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67c5f3800 with x1876514313433472 ext(0->12) 00002000:00010000:2.0:1789583776.185961:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b67c5f3800 00000100:00100000:2.0:1789583776.186000:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789583776.186012:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+11:2358:x1876514313433472:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789583776.186603:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2358:x1876514313433472:12345-192.168.203.46@tcp:4:lhsmtool_posix.0 Request processed in 590us (1570us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789583776.186613:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00002000:00100000:2.0:1789583776.186621:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff88b67c5f3800 x1876514313433472/t4294967320(0) o4->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:492/0 lens 504/448 e 0 to 0 dl 1789583787 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789583776.186631:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67c5f3800 with x1876514313433472 ext(0->12) 00002000:00010000:2.0:1789583776.186635:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b67c5f3800 00000100:00100000:1.0:1789583776.192710:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.196560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433600 00000100:00100000:3.0:1789583776.196582:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433600 00000100:00100000:3.0:1789583776.196692:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 226 00000100:00100000:2.0:1789583776.200256:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+66:11618:x1876514313433600:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789583776.239191:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1789583776.239242:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1789583776.239291:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:1.0:1789583776.239323:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1789583776.239349:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b661d02f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789583776.239355:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b66dfab200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b661d02d80 00000020:00080000:1.0:1789583776.239359:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b66dfab400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b674c01800 00000020:00080000:1.0:1789583776.239392:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b543d68840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789583776.239395:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b643123800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b543d68000 00000020:00080000:1.0:1789583776.239398:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b642ba9d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b67b6fbc00 00000020:00080000:1.0:1789583776.239407:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1789583776.239676:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11618:x1876514313433600:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 42945us (46973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.239689:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 226 00000100:00100000:1.0:1789583776.242054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.242527:0:9665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433728 00000100:00100000:3.0:1789583776.242541:0:9665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433728 00000100:00100000:3.0:1789583776.242626:0:9665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:3.0:1789583776.242639:0:9665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+13:2360:x1876514313433728:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000020:00080000:2.0:1789583776.243390:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:1.0:1789583776.243512:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789583776.243537:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332288512:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789583776.243627:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583776.243859:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332288640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789583776.243904:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583776.243939:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583776.243946:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332288768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789583776.243968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583776.244109:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332288512 00000100:00100000:1.0:1789583776.244118:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332288512 00000100:00100000:1.0:1789583776.244154:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332288640 00000100:00100000:1.0:1789583776.244157:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332288640 00000100:00100000:1.0:1789583776.244168:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332288768 00000100:00100000:1.0:1789583776.244171:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332288768 00000100:00100000:1.0:1789583776.244188:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789583776.244197:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876514332288512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789583776.244225:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1789583776.244267:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aaae19e, atime: 0x6aaae19e, ctime: 0x6aaae19e, blocks: 0x1 00010000:00010000:1.0:1789583776.244289:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.244327:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:1.0:1789583776.244332:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583776.244341:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.244361:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.244373:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.244383:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.244412:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789583776.245253:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332288512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1053us (1622us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789583776.245265:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789583776.245312:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789583776.245323:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876514332288640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789583776.245344:0:6702:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1789583776.245362:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.245382:0:6702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 13 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.245399:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789583776.245403:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789583776.245408:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.245446:0:6702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 13 pid: 9665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.245463:0:6702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 13 pid: 9665 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.245479:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1876514332288896:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583776.245558:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ae40 going to sleep for 11 seconds 00000020:00080000:2.0:1789583776.245863:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:1.0:1789583776.248033:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b67528d880/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789583776.248050:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332288512:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789583776.250341:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583776.250362:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.250380:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfaa00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583776.250387:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.250411:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.250439:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.250472:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f48b3db/0x6d3e73d72c6e3d5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.250504:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583776.250507:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583776.250509:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583776.252080:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.252151:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313433856 00000100:00100000:3.0:1789583776.252163:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313433856 00010000:00010000:3.0:1789583776.252208:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 14 pid: 9665 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583776.252255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:3.0:1789583776.252265:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:2359:x1876514313433856:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583776.252292:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583776.252299:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 14 pid: 9665 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.252313:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 14 pid: 9665 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.252341:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583776.252346:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789583776.252352:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.252379:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.252416:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583776.252480:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+14:2359:x1876514313433856:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 216us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.252488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00010000:00010000:0.0:1789583776.253090:0:6702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e55e9bc/0x6d3e73d72c6e3b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec66ac expref: 13 pid: 9665 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583776.253109:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6702:1876514332288896:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583776.253145:0:6702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.253155:0:6702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.253163:0:6702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.253173:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.253179:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.253200:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583776.254381:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583776.254410:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.254425:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583776.254430:0:7652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.254441:0:7652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.254465:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.254472:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e3d61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.254494:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583776.254505:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583776.254507:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583776.254602:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1876514332288640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9277us (10691us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789583776.254613:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789583776.254650:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789583776.254662:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1876514332288768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789583776.254920:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789583776.254925:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789583775 00002000:00010000:0.0:1789583776.254928:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789583776.254930:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789583775 -> 1789583775 00002000:00010000:0.0:1789583776.254933:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789583776.254979:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3307:x1876514332288768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 321us (11009us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789583776.254987:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:2.0:1789583776.261299:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b67528dc00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789583776.261319:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332288640:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789583776.261361:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b6763cad80/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789583776.261366:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332288768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789583776.290403:0:9665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+12:2360:x1876514313433728:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 47750us (48347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.290419:0:9665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:1.0:1789583776.292960:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.293167:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313434112 00000100:00100000:3.0:1789583776.293180:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313434112 00000100:00100000:3.0:1789583776.293249:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 227 00000100:00100000:3.0:1789583776.293260:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11618:x1876514313434112:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789583776.293349:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583776.293386:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3d45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec673f expref: 20 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.293409:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:3.0:1789583776.293415:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583776.293453:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.293470:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.293482:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583776.294409:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef92f902 reply state 000000008aee089e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583776.294426:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789583776.294708:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:0.0:1789583776.294722:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1789583776.294734:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1789583776.297159:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+21:11618:x1876514313434112:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 1322us (1633us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789583776.297207:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 227 00010000:00010000:0.0:1789583776.297692:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583776.298119:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.298133:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.298142:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.298149:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.298155:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.298163:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.298180:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:0.0:1789583776.298184:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583776.298190:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.298197:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483c00/0x6d3e73d72c6e3d68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.298792:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.299517:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313434240 00000100:00100000:2.0:1789583776.299531:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313434240 00000100:00100000:2.0:1789583776.299615:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:2.0:1789583776.299627:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313434240:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789583776.300192:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789583776.300197:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789583775 -> 1789583775 00002000:00010000:2.0:1789583776.300200:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789583774 00002000:00010000:2.0:1789583776.300203:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789583775 -> 1789583775 00002000:00010000:2.0:1789583776.300205:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789583776.300298:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313434240:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 673us (1511us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789583776.300308:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 70 00000100:00100000:1.0:1789583776.305349:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.305532:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313434496 00000100:00100000:2.0:1789583776.305546:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313434496 00000100:00100000:2.0:1789583776.305641:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 228 00000100:00100000:2.0:1789583776.305654:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+20:11618:x1876514313434496:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789583776.305744:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.305767:0:8280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 20 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.305777:0:8280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.305880:0:8280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 20 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.305898:0:8280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 20 pid: 8280 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.305940:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332289024:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583776.306098:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583776.309380:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583776.309459:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583776.309503:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.309612:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313434880 00000100:00100000:3.0:1789583776.309624:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313434880 00000100:00100000:3.0:1789583776.309709:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00100000:3.0:1789583776.309723:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313434880:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583776.309846:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313434880:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.309854:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 143 00000100:00080000:0.0:1789583776.309993:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583776.310306:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313434752 00000100:00100000:1.0:1789583776.310314:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313434752 00000100:00100000:2.0:1789583776.310423:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313434624 00000100:00100000:2.0:1789583776.310429:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313434624 00000100:00100000:2.0:1789583776.310484:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 291 00000100:00100000:2.0:1789583776.310494:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313434624:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583776.310545:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313434624:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 53us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583776.310907:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:1.0:1789583776.310917:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313434752:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583776.310951:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2359:x1876514313434752:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 37us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583776.310975:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:2.0:1789583776.311434:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 291 00000100:00080000:0.0:1789583776.313548:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583776.313895:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8280:1876514332289024:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583776.313937:0:8280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.315603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.315903:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313435008 00000100:00100000:2.0:1789583776.315917:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313435008 00010000:00010000:2.0:1789583776.315974:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 21 pid: 8280 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.316026:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:2.0:1789583776.316038:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:2358:x1876514313435008:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583776.316056:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583776.316064:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 21 pid: 8280 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.316100:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 21 pid: 8280 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.316128:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e3d29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6731 expref: 21 pid: 8280 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.316151:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:2.0:1789583776.316157:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.316168:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.316178:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.316223:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583776.316303:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+20:2358:x1876514313435008:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 266us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.316310:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00010000:00010000:0.0:1789583776.316334:0:8280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316343:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316386:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316395:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316402:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316409:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583776.316414:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316424:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316433:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:0.0:1789583776.316436:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789583776.316441:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.316447:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e3d6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583776.316504:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+19:11618:x1876514313434496:12345-192.168.203.46@tcp:55:lhsmtool_posix.0 Request processed in 10854us (11171us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789583776.316514:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 228 00000100:00100000:3.0:1789583776.324801:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.325011:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313435136 00000100:00100000:2.0:1789583776.325024:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313435136 00000100:00100000:2.0:1789583776.325101:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:2.0:1789583776.325113:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2358:x1876514313435136:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789583776.325169:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.325212:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.325222:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583776.325228:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789583776.325233:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.325287:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 8 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.325304:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 8 pid: 6702 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.325321:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332289152:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583776.325426:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583776.329434:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1876514332289152:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583776.329477:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583776.331340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.332751:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313435264 00000100:00100000:2.0:1789583776.332772:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313435264 00010000:00010000:2.0:1789583776.332864:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 9 pid: 6702 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.333072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:2.0:1789583776.333084:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+9:2359:x1876514313435264:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583776.333105:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583776.333138:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 9 pid: 6702 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.333154:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 9 pid: 6702 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.333181:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e12e480/0x6d3e73d72c6e3d53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec674d expref: 9 pid: 6702 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.333201:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789583776.333206:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789583776.333214:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.333225:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.333268:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583776.333367:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313435264:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 285us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.333375:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 00010000:00010000:1.0:1789583776.333512:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333522:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333555:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333564:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333572:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333579:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583776.333592:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333608:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333623:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.333644:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e3d76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.333727:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674d5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313435136:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 8618us (8940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583776.333735:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 71 00000100:00100000:3.0:1789583776.340600:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.340697:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313435520 00000100:00100000:2.0:1789583776.340710:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313435520 00000100:00100000:2.0:1789583776.340779:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 229 00000100:00100000:2.0:1789583776.340790:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+19:11618:x1876514313435520:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789583776.340942:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.340965:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.340980:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.341254:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.341268:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.341288:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.341330:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.341347:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 20 pid: 5850 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.341363:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332289280:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583776.341463:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583776.348923:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332289280:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583776.348965:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583776.349185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583776.349230:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313435648 00000100:00100000:2.0:1789583776.349238:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313435648 00010000:00010000:2.0:1789583776.349302:0:8527:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 21 pid: 5850 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.349339:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:2.0:1789583776.349349:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+21:2358:x1876514313435648:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583776.349366:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583776.349374:0:8527:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 21 pid: 5850 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.349387:0:8527:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 21 pid: 5850 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.349423:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482e00/0x6d3e73d72c6e3d37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6738 expref: 21 pid: 5850 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.349442:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:2.0:1789583776.349448:0:8527:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.349458:0:8527:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.349467:0:8527:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.349521:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583776.349593:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+20:2358:x1876514313435648:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 245us (409us total) trans 0 rc 0/0 00010000:00010000:0.0:1789583776.349861:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.349869:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.349870:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 85 00000001:00080000:0.0:1789583776.350121:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1789583776.350284:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789583776.350328:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1789583776.350421:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332289408:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789583776.350485:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583776.350530:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583776.350638:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332289408 00000100:00100000:2.0:1789583776.350647:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332289408 00000100:00100000:2.0:1789583776.350692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789583776.350701:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1876514332289408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789583776.350789:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1876514332289408:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.350796:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789583776.351797:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1789583776.351826:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1789583776.351859:0:5850:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff88b67528dc00 x1876514332288640/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789583792 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583776.352026:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332289408:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789583776.353688:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789583776.353855:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332289536:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789583776.354052:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583776.354151:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583776.354215:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332289536 00000100:00100000:2.0:1789583776.354225:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332289536 00000100:00100000:2.0:1789583776.354323:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789583776.354335:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1876514332289536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789583776.354605:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5850:x1876514332289536:12345-0@lo:1000:mdt00_002.0 Request processed in 271us (553us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789583776.354615:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789583776.354703:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5850:1876514332289536:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789583776.354749:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354761:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354769:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354776:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583776.354781:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354790:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354857:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b64336a100) 00010000:00010000:1.0:1789583776.354861:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583776.354868:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354886:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3d84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354926:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354934:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354940:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354945:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583776.354948:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354954:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354962:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583776.354965:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583776.354973:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.354986:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.355003:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.355037:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 23 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.355050:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332289664:192.168.203.46@tcp:105: 00000100:00100000:1.0:1789583776.355126:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583776.359768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583776.359958:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5850:1876514332289664:192.168.203.46@tcp:105: 00010000:00010000:1.0:1789583776.359996:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360009:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3cc7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360054:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360070:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360082:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360095:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360101:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360127:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360132:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583776.360137:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360145:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360158:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583776.360161:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583776.360165:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360172:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3d8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360182:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360189:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360208:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360214:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583776.360217:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360232:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360241:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583776.360243:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789583776.360246:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.360252:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3d7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583776.360576:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+23:11618:x1876514313435520:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 19785us (19988us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789583776.360599:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 229 00000020:00080000:1.0:1789583776.360608:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789583776.361439:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583776.361448:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583776.362016:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:2.0:1789583776.362028:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789583776.365189:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313435776 00000100:00100000:3.0:1789583776.365211:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313435776 00000100:00100000:0.0:1789583776.365575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583776.365752:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313436032 00000100:00100000:1.0:1789583776.365759:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313436032 00000100:00100000:1.0:1789583776.365867:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 61 00000100:00100000:1.0:1789583776.365886:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+24:11618:x1876514313436032:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789583776.366709:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789583776.366870:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1789583776.366933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.366955:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.366969:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.366993:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.367001:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.367007:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583776.367029:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789583776.367157:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511eb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11618:x1876514313436032:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1270us (1585us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789583776.367167:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 61 00000020:00080000:1.0:1789583776.367173:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789583776.369233:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 62 00000100:00100000:2.0:1789583776.369251:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+25:11617:x1876514313435776:12345-192.168.203.46@tcp:49:lfs.0 00000100:00100000:2.0:1789583776.369449:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+25:11617:x1876514313435776:12345-192.168.203.46@tcp:49:lfs.0 Request processed in 202us (9694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.369477:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 62 00010000:00010000:0.0:1789583776.369743:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583776.369754:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.369778:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583776.369784:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.369796:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.369857:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff88b660567700) 00010000:00010000:0.0:1789583776.369861:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789583776.369868:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.369882:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfbc00/0x6d3e73d72c6e3d92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583776.369908:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583776.369910:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583776.369912:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583776.373834:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.373984:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313436288 00000100:00100000:3.0:1789583776.373997:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313436288 00000100:00100000:3.0:1789583776.374074:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 230 00000100:00100000:3.0:1789583776.374087:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+25:11617:x1876514313436288:12345-192.168.203.46@tcp:58:lfs.0 00000040:00080000:3.0:1789583776.374571:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789583776.374753:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+25:11617:x1876514313436288:12345-192.168.203.46@tcp:58:lfs.0 Request processed in 668us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.374763:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 230 00000100:00100000:3.0:1789583776.409641:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583776.411650:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313436416 00000100:00100000:1.0:1789583776.412860:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313436416 00000100:00100000:2.0:1789583776.413204:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 231 00000100:00100000:2.0:1789583776.413219:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+25:11620:x1876514313436416:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583776.413247:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583776.413285:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3d99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6754 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413374:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413391:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413406:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413424:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413432:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413439:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413921:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413935:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.413959:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.414006:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.414023:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 26 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.414040:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332289792:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583776.414238:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68480 going to sleep for 11 seconds 00000100:00100000:1.0:1789583776.417580:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.417666:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313436672 00000100:00100000:3.0:1789583776.417678:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313436672 00000100:00100000:3.0:1789583776.417752:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:3.0:1789583776.417764:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+27:5596:x1876514313436672:12345-192.168.203.46@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789583776.418122:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:5596:x1876514313436672:12345-192.168.203.46@tcp:35:ldlm_bl.0 Request processed in 359us (554us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789583776.418132:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 63 00000100:00100000:0.0:1789583776.420636:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583776.420731:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313436800 00000100:00100000:3.0:1789583776.420745:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313436800 00010000:00010000:3.0:1789583776.420800:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 28 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583776.420909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:3.0:1789583776.420924:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:2358:x1876514313436800:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583776.420946:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583776.420955:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 28 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.420972:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 28 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.421004:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:3.0:1789583776.421012:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.421024:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.421034:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583776.421060:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583776.421148:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+28:2358:x1876514313436800:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 228us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583776.421157:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 86 00010000:00010000:2.0:1789583776.423182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfa400/0x6d3e73d72c6e3cb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6715 expref: 27 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583776.423217:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5848:1876514332289792:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583776.423252:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423265:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423282:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583776.423342:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789583776.423347:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583776.423371:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423558:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423571:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423578:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423585:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423652:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583776.423657:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423667:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423684:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:2.0:1789583776.423687:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583776.423692:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423700:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1400/0x6d3e73d72c6e3da0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423715:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423721:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423734:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423740:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583776.423743:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423749:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423758:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff88b6583d4900) 00010000:00010000:2.0:1789583776.423761:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583776.423764:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423770:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e3da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423978:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e3d99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6754 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.423996:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6754 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583776.424004:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:2.0:1789583776.424006:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583776.424009:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1600, rc 0) 00000100:00100000:2.0:1789583776.424138:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11620:x1876514313436416:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 10922us (14510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583776.424157:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 231 00000040:00080000:3.0:1789583777.230124:0:12576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789583777.230139:0:12576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789583777.230201:0:12576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:3.0:1789583777.230208:0:12576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789583777.321037:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583777.383212:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583777.383227:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583777.383283:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1789583777.383291:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789583777.383460:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332289920:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789583777.383589:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bbacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583777.387739:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583777.387850:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1876514332289920:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789583777.388052:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313436928 00000100:00100000:0.0:1789583777.388062:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313436928 00000100:00100000:0.0:1789583777.388393:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 232 00000100:00100000:0.0:1789583777.388406:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11632:x1876514313436928:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789583777.388452:0:8280:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789583777.388592:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11632:x1876514313436928:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 188us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583777.388600:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 232 00000100:00100000:0.0:1789583777.391595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583777.391680:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313437184 00000100:00100000:2.0:1789583777.391692:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313437184 00000100:00100000:2.0:1789583777.391758:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 233 00000100:00100000:2.0:1789583777.391768:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+26:11632:x1876514313437184:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583777.391794:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583777.391843:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3db5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec675b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583777.392097:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583777.392115:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583777.392130:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583777.392145:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:1.0:1789583777.392299:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789583777.392326:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e3db5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec675b expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583777.392342:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec675b expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583777.392352:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:2.0:1789583777.392364:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583777.392369:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0a00, rc 0) 00000100:00100000:1.0:1789583777.392836:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+28:11632:x1876514313437184:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1065us (1255us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789583777.392854:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 233 00000100:00100000:0.0:1789583777.397157:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583777.397203:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313437440 00000100:00100000:0.0:1789583777.397214:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313437440 00000100:00100000:0.0:1789583777.397290:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 234 00000100:00100000:0.0:1789583777.397302:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+28:11632:x1876514313437440:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789583777.398450:0:8280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398477:0:8280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398492:0:8280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398743:0:8280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398751:0:8280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398759:0:8280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398766:0:8280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583777.398771:0:8280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398780:0:8280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398795:0:8280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583777.398829:0:8280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789583777.398837:0:8280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.398844:0:8280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e3dca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583777.403175:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+29:11632:x1876514313437440:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 5858us (6015us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789583777.403194:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 234 00000040:00080000:3.0:1789583777.404863:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789583777.404874:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789583777.406505:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583777.406554:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313437568 00000100:00100000:0.0:1789583777.406567:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313437568 00000100:00100000:0.0:1789583777.406659:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:0.0:1789583777.406670:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b980380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+29:2359:x1876514313437568:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583777.406690:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583777.406722:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e3dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec675b expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583777.406744:0:8527:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583777.406750:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583777.406832:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b980380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:768b736a-7b4a-4614-9d07-b155a4183a8a+28:2359:x1876514313437568:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 163us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583777.406840:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000040:00080000:3.0:1789583777.407404:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:3.0:1789583777.407422:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789583777.408667:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583777.408707:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313437824 00000100:00100000:1.0:1789583777.408717:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313437824 00000100:00100000:1.0:1789583777.408772:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 64 00000100:00100000:1.0:1789583777.408784:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+28:11632:x1876514313437824:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789583777.410292:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+29:11632:x1876514313437824:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1499us (1621us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789583777.410305:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 64 00010000:00010000:0.0:1789583778.343016:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789583778.471138:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789583778.471151:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789583778.471369:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789583778.471378:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789583779.019335:0:12627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789583779.019346:0:12627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583779.019397:0:12627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789583779.019403:0:12627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789583779.195721:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583779.195782:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438080 00000100:00100000:0.0:1789583779.195794:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438080 00000100:00080000:1.0:1789583779.196710:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583779.198312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 235 00000100:00100000:0.0:1789583779.198332:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+29:11652:x1876514313438080:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:0.0:1789583779.198363:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583779.198499:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55c00/0x6d3e73d72c6e3dd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6762 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.198780:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3dd8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.198798:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.198939:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3dd8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583779.198956:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789583779.199356:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55c00/0x6d3e73d72c6e3dd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6762 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.199512:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6762 expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.199523:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583779.199526:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789583779.199531:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54e00, rc 0) 00000100:00100000:0.0:1789583779.199781:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+31:11652:x1876514313438080:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1455us (4080us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789583779.199791:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 235 00000100:00100000:1.0:1789583779.202740:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583779.202788:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438208 00000100:00100000:1.0:1789583779.202799:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438208 00000100:00100000:1.0:1789583779.202906:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 236 00000100:00100000:1.0:1789583779.202917:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+31:11652:x1876514313438208:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:1.0:1789583779.204421:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204613:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204632:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204676:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204685:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204769:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204779:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583779.204785:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204793:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204831:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:1.0:1789583779.204835:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583779.204842:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583779.204957:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b652cfb400/0x6d3e73d72c6e3de6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583779.205146:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+31:11652:x1876514313438208:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 2225us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583779.205157:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 236 00000100:00100000:1.0:1789583779.324106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583779.324218:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438336 00000100:00100000:0.0:1789583779.324248:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438336 00000100:00100000:0.0:1789583779.324348:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:0.0:1789583779.324359:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2360:x1876514313438336:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:0.0:1789583779.324376:0:6702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583779.324397:0:6702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000262d83ce/0x6d3e73d72c6e3ded lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6769 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789583779.324423:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789583779.324425:0:6702:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aaae19f, atime: 0x6aaae19e, ctime: 0x6aaae19f, blocks: 0xb 00010000:00010000:0.0:1789583779.324446:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1789583779.324450:0:6702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583779.324459:0:6702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000262d83ce/0x6d3e73d72c6e3ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6769 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.324478:0:6702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000262d83ce/0x6d3e73d72c6e3ded lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6769 expref: 8 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583779.324491:0:6702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df55000, rc 0) 00000100:00100000:0.0:1789583779.325184:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2360:x1876514313438336:12345-192.168.203.46@tcp:101:cat.0 Request processed in 824us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583779.325193:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 72 00000100:00100000:0.0:1789583779.330985:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583779.331235:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438464 00000100:00100000:1.0:1789583779.331247:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438464 00002000:00100000:1.0:1789583779.331331:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88b67b1cf480 x1876514313438464/t0(0) o3->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:495/0 lens 488/0 e 0 to 0 dl 1789583790 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789583779.331345:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b1cf480 with x1876514313438464 ext(0->4095) 00002000:00010000:1.0:1789583779.331353:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b67b1cf480 00000100:00100000:1.0:1789583779.331472:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:1.0:1789583779.331486:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313438464:12345-192.168.203.46@tcp:3:cat.0 00000100:00100000:1.0:1789583779.333305:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2359:x1876514313438464:12345-192.168.203.46@tcp:3:cat.0 Request processed in 1810us (2323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789583779.333319:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00002000:00100000:1.0:1789583779.333331:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff88b67b1cf480 x1876514313438464/t0(0) o3->768b736a-7b4a-4614-9d07-b155a4183a8a@192.168.203.46@tcp:495/0 lens 488/4536 e 0 to 0 dl 1789583790 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789583779.333341:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88b67b1cf480 with x1876514313438464 ext(0->4095) 00002000:00010000:1.0:1789583779.333348:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88b67b1cf480 00010000:00010000:0.0:1789583779.367016:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789583779.406847:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789583779.406875:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:1.0:1789583780.392099:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583780.392358:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332290048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583780.392441:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583780.392518:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789583780.392546:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583780.392563:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332290176:0@lo:400:kworker.0 00000100:00100000:3.0:1789583780.392605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583780.392639:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332290688:0@lo:400:kworker.0 00000100:00100000:3.0:1789583780.392661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583780.392692:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290688 00000100:00100000:3.0:1789583780.392698:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290688 00000100:00100000:3.0:1789583780.392748:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789583780.392757:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332290688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583780.392800:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332290688:12345-0@lo:400:kworker.0 Request processed in 45us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583780.392827:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789583780.392923:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583780.392949:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789583780.392954:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789583780.392987:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b67528d880, transno 4294967310 00000100:00100000:3.0:1789583780.392998:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332290688:0@lo:400:kworker.0 00000100:00100000:1.0:1789583780.393074:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290560 00000100:00100000:1.0:1789583780.393079:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290560 00000100:00100000:0.0:1789583780.393100:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290176 00000100:00100000:0.0:1789583780.393106:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290176 00000100:00100000:1.0:1789583780.393118:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789583780.393128:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332290560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583780.393154:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789583780.393171:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332290176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583780.393176:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876514332290560:12345-0@lo:400:kworker.0 Request processed in 49us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583780.393183:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789583780.393229:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3305:1876514332290560:0@lo:400:kworker.0 00000100:00100000:0.0:1789583780.393424:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3306:x1876514332290176:12345-0@lo:400:kworker.0 Request processed in 255us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583780.393430:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789583780.393674:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290048 00000100:00100000:2.0:1789583780.393680:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290048 00000100:00100000:2.0:1789583780.393720:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789583780.393728:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1876514332290048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583780.393757:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583780.393801:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1876514332290048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583780.393831:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789583780.393854:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332290304:0@lo:400:kworker.0 00000100:00100000:2.0:1789583780.393882:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583780.393904:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583780.393910:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332290432:0@lo:400:kworker.0 00000100:00100000:2.0:1789583780.393930:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789583780.394224:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789583780.394229:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583780.394279:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332290048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583780.394307:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290304 00000100:00100000:3.0:1789583780.394311:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290304 00000100:00100000:3.0:1789583780.394335:0:8280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290432 00000100:00100000:3.0:1789583780.394338:0:8280:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290432 00000100:00100000:3.0:1789583780.394358:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789583780.394365:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332290304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583780.394419:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332290304:12345-0@lo:400:kworker.0 Request processed in 55us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583780.394425:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789583780.394438:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789583780.394443:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332290432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583780.394470:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876514332290432:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583780.394476:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1789583780.394493:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789583780.394666:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3307:1876514332290432:0@lo:400:kworker.0 00000100:00100000:0.0:1789583780.394678:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332290304:0@lo:400:kworker.0 00000100:00100000:1.0:1789583780.395114:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332290176:0@lo:400:kworker.0 00000100:00100000:3.0:1789583780.904885:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583780.904907:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583780.904974:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583780.905326:0:12442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290816 00000100:00100000:2.0:1789583780.905334:0:12442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290816 00000100:00100000:2.0:1789583780.905389:0:12442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789583780.905399:0:12442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332290816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789583780.905435:0:12442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583780.905477:0:12442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332290816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583780.905483:0:12442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789583780.905594:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332290816:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789583781.418880:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583781.437286:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583781.437334:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583781.437370:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583781.437409:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583781.437468:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583781.437545:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438592 00000100:00100000:1.0:1789583781.437570:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438592 00000100:00100000:0.0:1789583781.437779:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438848 00000100:00100000:0.0:1789583781.437784:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438848 00000100:00100000:0.0:1789583781.437895:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438976 00000100:00100000:0.0:1789583781.437898:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438976 00000100:00100000:0.0:1789583781.437926:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:0.0:1789583781.437937:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2361:x1876514313438848:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583781.438145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 293 00000100:00100000:1.0:1789583781.438153:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313438592:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583781.438194:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313438592:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 41us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583781.438202:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 293 00000100:00100000:1.0:1789583781.438254:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313438720 00000100:00100000:1.0:1789583781.438259:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313438720 00000100:00100000:1.0:1789583781.438289:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313439104 00000100:00100000:1.0:1789583781.438292:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313439104 00000100:00100000:1.0:1789583781.438312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 147 00000100:00100000:1.0:1789583781.438319:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+31:2361:x1876514313438720:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583781.438348:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+31:2361:x1876514313438720:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 30us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583781.438355:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 147 00000100:00100000:1.0:1789583781.438366:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:1.0:1789583781.438373:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313439104:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583781.438396:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2360:x1876514313439104:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583781.438402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 148 00000100:00100000:0.0:1789583781.438708:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+8:2361:x1876514313438848:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 771us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583781.438716:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:0.0:1789583781.438738:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:0.0:1789583781.438746:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313438976:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583781.438776:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2361:x1876514313438976:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 32us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583781.438782:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00080000:2.0:1789583781.440226:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583781.440246:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789583781.440250:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789583781.481013:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1789583781.481035:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1789583781.481057:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1789583781.490755:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789583781.491033:0:5871:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88b661c15b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789583781.491039:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b650ca5800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88b661c15a80 00000020:00080000:3.0:1789583781.491043:0:5871:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88b650ca5900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88b675238800 00000020:00080000:3.0:1789583781.491143:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789583781.491153:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789583781.491594:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789583782.439086:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583783.458287:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583783.459431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313439232 00000100:00100000:1.0:1789583783.459448:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313439232 00000100:00100000:1.0:1789583783.459540:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 237 00000100:00100000:1.0:1789583783.459554:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b1cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11306:x1876514313439232:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789583783.459684:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b1cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11306:x1876514313439232:12345-192.168.203.46@tcp:60:lhsmtool_posix.0 Request processed in 134us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583783.459700:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 237 00000100:00080000:2.0:1789583783.459859:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583783.465917:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583783.465965:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313439488 00000100:00100000:1.0:1789583783.465976:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313439488 00000100:00100000:1.0:1789583783.466058:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 65 00000100:00100000:1.0:1789583783.466071:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+18:11306:x1876514313439488:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789583783.467689:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:11306:x1876514313439488:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1613us (1778us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789583783.467704:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 65 00010000:00010000:1.0:1789583783.478963:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583784.487327:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789583785.183064:0:12829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:36:23 (1789583783) 00010000:00010000:0.0:1789583785.511048:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583785.511076:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332291328:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.511177:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583785.511253:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789583785.511260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332290944:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.511293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583785.511314:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332291456:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.511421:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583785.511450:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332291200:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.511474:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583785.511493:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789583785.511498:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332291072:0@lo:400:kworker.0 00000100:00100000:3.0:1789583785.511666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332290944 00000100:00100000:3.0:1789583785.511677:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332290944 00000100:00100000:3.0:1789583785.511731:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789583785.511743:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332290944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583785.511823:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332290944:12345-0@lo:400:kworker.0 Request processed in 82us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583785.511831:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789583785.511900:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789583785.511908:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332291712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583785.511936:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583785.511964:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291712 00000100:00100000:3.0:1789583785.511969:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291712 00000100:00100000:3.0:1789583785.512009:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789583785.512016:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67b5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332291712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583785.512051:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583785.512089:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67b5a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332291712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583785.512096:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789583785.512113:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583785.512145:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789583785.512161:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b67528dc00, transno 4294967321 00000004:00080000:3.0:1789583785.512172:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b6763cad80, transno 4294967322 00000004:00080000:3.0:1789583785.512178:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789583785.512222:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332291712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583785.512436:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583785.512460:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67509f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332291584:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.512488:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583785.513781:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291328 00000100:00100000:0.0:1789583785.513799:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291328 00000100:00100000:0.0:1789583785.513899:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291584 00000100:00100000:0.0:1789583785.513903:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291584 00000100:00100000:0.0:1789583785.513949:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789583785.513960:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332291328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.514055:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6488b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332291328:12345-0@lo:400:kworker.0 Request processed in 97us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583785.514077:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789583785.514114:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789583785.514121:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332291584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.514161:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332291584:12345-0@lo:400:kworker.0 Request processed in 40us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583785.514166:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789583785.514196:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291456 00000100:00100000:0.0:1789583785.514200:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291456 00000100:00100000:0.0:1789583785.514244:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291200 00000100:00100000:0.0:1789583785.514248:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291200 00000100:00100000:0.0:1789583785.514264:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291072 00000100:00100000:0.0:1789583785.514267:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291072 00000100:00100000:0.0:1789583785.514281:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789583785.514288:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332291456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.514331:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332291456:12345-0@lo:400:kworker.0 Request processed in 33us (2899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583785.514338:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789583785.514351:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789583785.514356:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332291200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.514383:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332291200:12345-0@lo:400:kworker.0 Request processed in 28us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583785.514389:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789583785.514403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789583785.514410:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332291072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.514436:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332291072:12345-0@lo:400:kworker.0 Request processed in 28us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583785.514451:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1789583785.514763:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789583785.514771:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583785.514838:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b1cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332290944:0@lo:400:kworker.0 00000100:00100000:2.0:1789583785.514863:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332291456:0@lo:400:kworker.0 00000100:00100000:2.0:1789583785.514880:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332291328:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.515312:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332291072:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.515388:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332291584:0@lo:400:kworker.0 00000100:00100000:0.0:1789583785.515402:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67509ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332291200:0@lo:400:kworker.0 00000100:00100000:3.0:1789583786.023381:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583786.023406:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67b5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332291840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583786.023477:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583786.023550:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291840 00000100:00100000:3.0:1789583786.023558:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291840 00000100:00100000:3.0:1789583786.023610:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789583786.023621:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332291840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583786.025382:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583786.025477:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64a1df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332291840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1856us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583786.025487:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789583786.025791:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67b5a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332291840:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583786.538530:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583786.549568:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583786.549612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583786.549637:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583786.549654:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583786.549675:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583786.549727:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313439872 00000100:00100000:3.0:1789583786.549738:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313439872 00000100:00100000:3.0:1789583786.549841:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313440000 00000100:00100000:3.0:1789583786.549844:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313440000 00000100:00100000:3.0:1789583786.549868:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:3.0:1789583786.549879:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313439872:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583786.549959:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2358:x1876514313439872:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 82us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583786.549984:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:3.0:1789583786.550001:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:3.0:1789583786.550007:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313440000:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583786.550029:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2359:x1876514313440000:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 23us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583786.550034:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:3.0:1789583786.550054:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313439744 00000100:00100000:3.0:1789583786.550057:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313439744 00000100:00100000:3.0:1789583786.550086:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313440128 00000100:00100000:3.0:1789583786.550089:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313440128 00000100:00100000:3.0:1789583786.550105:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:3.0:1789583786.550111:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:2359:x1876514313439744:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583786.550142:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:2359:x1876514313439744:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583786.550148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 152 00000100:00100000:3.0:1789583786.550157:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00100000:3.0:1789583786.550162:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313440128:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583786.550179:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:2358:x1876514313440128:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 17us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583786.550185:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 153 00000100:00080000:3.0:1789583786.550215:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789583786.550221:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583786.550223:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583786.550559:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313439616 00000100:00100000:3.0:1789583786.550564:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313439616 00000100:00100000:3.0:1789583786.550604:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 295 00000100:00100000:3.0:1789583786.550612:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313439616:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583786.550655:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b5c501b0-a566-4083-bb80-bae594ae6290+13:2358:x1876514313439616:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 44us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583786.550662:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 295 00000001:00080000:1.0:1789583786.626236:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789583786.626271:0:5871:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789583786.626291:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789583786.626307:0:5882:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1789583787.391247:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583787.391554:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313440256 00000100:00100000:0.0:1789583787.391572:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313440256 00000100:00100000:0.0:1789583787.391666:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 238 00000100:00100000:0.0:1789583787.391680:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+5:12317:x1876514313440256:12345-192.168.203.46@tcp:101:lsof.0 00010000:00010000:0.0:1789583787.391707:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583787.391737:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583787.391882:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3dfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583787.391901:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583787.391918:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583787.391972:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789583787.391977:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583787.392029:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583787.392057:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55200/0x6d3e73d72c6e3df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6770 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583787.392112:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6770 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583787.392121:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:0.0:1789583787.392124:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583787.392128:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df55800, rc 0) 00000100:00100000:0.0:1789583787.392223:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:12317:x1876514313440256:12345-192.168.203.46@tcp:101:lsof.0 Request processed in 547us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583787.392232:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 238 00010000:00010000:0.0:1789583787.559173:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583788.583383:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583788.711151:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789583788.711163:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583788.711702:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789583788.711711:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789583788.918506:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583788.918838:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313440512 00000100:00100000:1.0:1789583788.918852:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313440512 00000100:00080000:3.0:1789583788.919068:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583788.919198:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:1.0:1789583788.919213:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+18:12318:x1876514313440512:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:1.0:1789583788.920338:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+19:12318:x1876514313440512:12345-192.168.203.46@tcp:35:umount.0 Request processed in 1119us (1837us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789583788.920352:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 66 00000100:00100000:3.0:1789583788.924426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583788.924697:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313440768 00000100:00100000:2.0:1789583788.924711:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313440768 00000100:00100000:2.0:1789583788.924898:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:2.0:1789583788.924910:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+19:12318:x1876514313440768:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:2.0:1789583788.925662:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+20:12318:x1876514313440768:12345-192.168.203.46@tcp:35:umount.0 Request processed in 750us (1250us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789583788.925674:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 67 00000100:00100000:3.0:1789583788.929294:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583788.929685:0:11497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313441024 00000100:00100000:1.0:1789583788.929700:0:11497:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313441024 00000100:00100000:1.0:1789583788.929800:0:11497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:1.0:1789583788.929851:0:11497:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6511e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+20:12318:x1876514313441024:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:1.0:1789583788.930463:0:11497:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6511e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+21:12318:x1876514313441024:12345-192.168.203.46@tcp:35:umount.0 Request processed in 613us (1180us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789583788.930473:0:11497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 68 00000100:00100000:3.0:1789583788.935748:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583788.936753:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313441280 00000100:00100000:2.0:1789583788.936801:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313441280 00000100:00100000:2.0:1789583788.936926:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583788.936940:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+21:12318:x1876514313441280:12345-192.168.203.46@tcp:35:umount.0 00000100:00100000:2.0:1789583788.937796:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:768b736a-7b4a-4614-9d07-b155a4183a8a+22:12318:x1876514313441280:12345-192.168.203.46@tcp:35:umount.0 Request processed in 850us (2054us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789583788.937830:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 69 00000100:00100000:2.0:1789583788.942698:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583788.943609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313441536 00000100:00100000:0.0:1789583788.943624:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313441536 00000100:00100000:0.0:1789583788.943721:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:0.0:1789583788.943734:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5c501b0-a566-4083-bb80-bae594ae6290+13:2361:x1876514313441536:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789583788.943753:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583788.943779:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1000/0x6d3e73d72c6e3095 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63cd expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.943803:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583788.943976:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b5c501b0-a566-4083-bb80-bae594ae6290+12:2361:x1876514313441536:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 243us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583788.943984:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:1.0:1789583788.947702:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583788.947946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583788.949791:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583788.949950:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313441792 00000100:00100000:0.0:1789583788.949963:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313441792 00000100:00100000:0.0:1789583788.950050:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 73 00000100:00100000:0.0:1789583788.950062:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2357:x1876514313441792:12345-192.168.203.46@tcp:9:umount.0 00000020:00000080:0.0:1789583788.950122:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e3159 00000100:00080000:0.0:1789583788.950136:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b644562000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789583788.950199:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789583788.950583:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+2:2357:x1876514313441792:12345-192.168.203.46@tcp:9:umount.0 Request processed in 523us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583788.950591:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 73 00010000:00010000:0.0:1789583788.950623:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583788.954223:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583788.956916:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313441408 00000100:00100000:2.0:1789583788.956937:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313441408 00000100:00100000:2.0:1789583788.957093:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313441664 00000100:00100000:2.0:1789583788.957098:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313441664 00000100:00100000:1.0:1789583788.957577:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583788.957633:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789583788.957645:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+13:2359:x1876514313441408:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583788.957667:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583788.957693:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a03200/0x6d3e73d72c6e2e81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6302 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583788.957716:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583788.957797:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+12:2359:x1876514313441408:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 154us (10109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583788.957823:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:1.0:1789583788.957966:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:1.0:1789583788.957975:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+11:2359:x1876514313441664:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583788.957984:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583788.957995:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a02000/0x6d3e73d72c6e2de7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec62ca expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583788.958006:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583788.958031:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b5c501b0-a566-4083-bb80-bae594ae6290+10:2359:x1876514313441664:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 57us (10085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583788.958056:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:3.0:1789583788.958115:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313442176 00000100:00100000:3.0:1789583788.958122:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313442176 00000100:00100000:3.0:1789583788.958169:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00100000:3.0:1789583788.958177:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2357:x1876514313442176:12345-192.168.203.46@tcp:9:umount.0 00000020:00000080:3.0:1789583788.958217:0:6705:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e33ba 00000020:00010000:3.0:1789583788.958227:0:6705:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88b6751f6800: total 0 00000100:00080000:3.0:1789583788.958233:0:6705:0:(import.c:65:import_set_state_nolock()) ffff88b6751f0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789583788.958277:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789583788.958580:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:768b736a-7b4a-4614-9d07-b155a4183a8a+5:2357:x1876514313442176:12345-192.168.203.46@tcp:9:umount.0 Request processed in 401us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583788.958588:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 74 00000100:00080000:3.0:1789583788.958613:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1789583788.958624:0:5837:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88b6751f6800: total 0 00010000:00010000:3.0:1789583788.958644:0:5837:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88b6751f6800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1789583788.958701:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd6de73/0x6d3e73d72c6e375d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65a2 expref: 4 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583788.958758:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000262d83ce/0x6d3e73d72c6e3ded lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6769 expref: 3 pid: 6702 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583788.958773:0:5837:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88b6751f6800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1789583788.958787:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583788.958789:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583788.958791:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583788.967029:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583788.967077:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313443200 00000100:00100000:3.0:1789583788.967089:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313443200 00000100:00100000:3.0:1789583788.967166:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 239 00000100:00100000:3.0:1789583788.967189:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+22:2357:x1876514313443200:12345-192.168.203.46@tcp:39:umount.0 00000020:00000080:3.0:1789583788.967235:0:5848:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2df5 00000020:00010000:3.0:1789583788.967255:0:5848:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88b675259000: total 0 00000100:00080000:3.0:1789583788.967261:0:5848:0:(import.c:65:import_set_state_nolock()) ffff88b674e39000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789583788.967290:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1789583788.967909:0:5836:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88b675259000: total 0 00010000:00010000:0.0:1789583788.967971:0:5836:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88b675259000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789583788.968008:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64336a300) 00010000:00010000:0.0:1789583788.968012:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583788.968023:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a02400/0x6d3e73d72c6e30db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63e2 expref: 23 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968053:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583788.968056:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789583788.968060:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483a00/0x6d3e73d72c6e3aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6690 expref: 22 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968073:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583788.968075:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583788.968079:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752cba00/0x6d3e73d72c6e371e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec658d expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968091:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583788.968094:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789583788.968097:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f400/0x6d3e73d72c6e3748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec659b expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968132:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583788.968135:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789583788.968139:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54000/0x6d3e73d72c6e3cce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec671c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968150:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff88b643e76600) 00010000:00010000:0.0:1789583788.968152:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789583788.968155:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6752ca600/0x6d3e73d72c6e37cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65be expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968170:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:0.0:1789583788.968172:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583788.968176:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e37b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec65b7 expref: 17 pid: 8280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968199:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:0.0:1789583788.968201:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789583788.968205:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03800/0x6d3e73d72c6e341c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec64c9 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968217:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88b6583d4100) 00010000:00010000:0.0:1789583788.968219:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583788.968223:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e30bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63db expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968240:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583788.968242:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789583788.968251:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54e00/0x6d3e73d72c6e3dd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6762 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968264:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:0.0:1789583788.968266:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789583788.968269:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03400/0x6d3e73d72c6e363e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6555 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968285:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff88b643e76000) 00010000:00010000:0.0:1789583788.968287:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583788.968291:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1600/0x6d3e73d72c6e3dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6754 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968308:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff88b64336a500) 00010000:00010000:0.0:1789583788.968310:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789583788.968314:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b645a03000/0x6d3e73d72c6e312f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63f7 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583788.968327:0:5836:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88b675259000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789583788.968342:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583788.968344:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583788.968346:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583788.969014:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:768b736a-7b4a-4614-9d07-b155a4183a8a+7:2357:x1876514313443200:12345-192.168.203.46@tcp:39:umount.0 Request processed in 1831us (1994us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789583788.969026:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 239 00010000:00010000:0.0:1789583789.607082:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789583789.677754:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:0.0:1789583789.677765:0:7663:0:(genops.c:885:class_export_put()) final put ffff88b644567000/768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:2.0:1789583789.677874:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b644567000/768b736a-7b4a-4614-9d07-b155a4183a8a for lustre-OST0001 00000020:00000080:2.0:1789583789.677936:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b644562000 for lustre-OST0001 00000100:00100000:2.0:1789583790.631285:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332292224:0@lo:400:kworker.0 00000100:00100000:1.0:1789583790.631362:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332292352:0@lo:400:kworker.0 00000100:00100000:2.0:1789583790.631390:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583790.631398:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583790.631468:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332291968:0@lo:400:kworker.0 00000100:00100000:1.0:1789583790.631483:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292352 00000100:00100000:1.0:1789583790.631492:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292352 00000100:00100000:0.0:1789583790.631508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583790.631531:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332292480:0@lo:400:kworker.0 00000100:00100000:0.0:1789583790.631576:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583790.631585:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789583790.631596:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583790.631667:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332292352:12345-0@lo:400:kworker.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583790.631675:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789583790.631710:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332291968 00000100:00100000:1.0:1789583790.631714:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332291968 00000100:00100000:0.0:1789583790.631757:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332292352:0@lo:400:kworker.0 00000100:00100000:0.0:1789583790.631800:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332292096:0@lo:400:kworker.0 00000100:00100000:0.0:1789583790.631846:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583790.631865:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332292608:0@lo:400:kworker.0 00000100:00100000:0.0:1789583790.631888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789583790.632661:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583790.632687:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292224 00000100:00100000:3.0:1789583790.632695:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292224 00000100:00100000:3.0:1789583790.632744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292480 00000100:00100000:3.0:1789583790.632747:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292480 00000100:00100000:3.0:1789583790.632760:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292096 00000100:00100000:2.0:1789583790.632895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789583790.632907:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332292224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583790.632978:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332292224:12345-0@lo:400:kworker.0 Request processed in 73us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583790.632985:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789583790.633003:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789583790.633009:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332292480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583790.633042:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332292480:12345-0@lo:400:kworker.0 Request processed in 33us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583790.633048:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789583790.633084:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332292480:0@lo:400:kworker.0 00000100:00100000:2.0:1789583790.633128:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332292224:0@lo:400:kworker.0 00000100:00080000:2.0:1789583790.633158:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583790.633217:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332292736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583790.633253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583790.633289:0:12442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292736 00000100:00100000:2.0:1789583790.633293:0:12442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292736 00000100:00100000:2.0:1789583790.633324:0:12442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789583790.633332:0:12442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332292736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583790.633366:0:12442:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583790.633478:0:12442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674d95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332292736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583790.633486:0:12442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789583790.633740:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332292736:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789583790.633861:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583790.634118:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292096 00000100:00100000:3.0:1789583790.634159:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789583790.634290:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332292096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583790.634340:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332292096:12345-0@lo:400:kworker.0 Request processed in 175us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583790.634347:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789583790.638327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789583790.638360:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3308:x1876514332291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583790.638737:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3308:x1876514332291968:12345-0@lo:400:kworker.0 Request processed in 394us (7225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583790.638747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789583790.638861:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332291968:0@lo:400:kworker.0 00000100:00100000:0.0:1789583790.640041:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332292096:0@lo:400:kworker.0 00000100:00100000:3.0:1789583790.640328:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292608 00000100:00100000:3.0:1789583790.640338:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292608 00000100:00100000:3.0:1789583790.640422:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789583790.640433:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332292608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789583790.640876:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583790.641779:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332292608:12345-0@lo:400:kworker.0 Request processed in 1341us (9882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583790.641792:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789583790.641848:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332292608:0@lo:400:kworker.0 00000100:00100000:0.0:1789583790.827133:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583790.827198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583790.827259:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583790.827410:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313443328 00000100:00100000:1.0:1789583790.827424:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313443328 00000100:00100000:1.0:1789583790.827503:0:8527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313443584 00000100:00100000:1.0:1789583790.827507:0:8527:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313443584 00000100:00100000:3.0:1789583790.827521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313443456 00000100:00100000:3.0:1789583790.827525:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313443456 00000100:00100000:1.0:1789583790.827528:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789583790.827537:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b5c501b0-a566-4083-bb80-bae594ae6290+12:2361:x1876514313443328:12345-192.168.203.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789583790.827546:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:3.0:1789583790.827552:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5c501b0-a566-4083-bb80-bae594ae6290+12:2361:x1876514313443584:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583790.827564:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583790.827564:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583790.827589:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a0000/0x6d3e73d72c6e308e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec63c6 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583790.827589:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cb400/0x6d3e73d72c6e2ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6317 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583790.827609:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789583790.827609:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583790.834925:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b5c501b0-a566-4083-bb80-bae594ae6290+10:2361:x1876514313443328:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 7369us (7787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583790.834946:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:1.0:1789583790.835000:0:8527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:1.0:1789583790.835015:0:8527:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b66678c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b5c501b0-a566-4083-bb80-bae594ae6290+9:2361:x1876514313443456:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583790.835040:0:8527:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583790.835069:0:8527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e2ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6341 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583790.835091:0:8527:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583790.835122:0:8527:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b66678c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b5c501b0-a566-4083-bb80-bae594ae6290+8:2361:x1876514313443456:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 113us (7862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583790.835129:0:8527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:3.0:1789583790.837602:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b5c501b0-a566-4083-bb80-bae594ae6290+7:2361:x1876514313443584:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 10033us (10386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583790.837620:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:2.0:1789583790.837665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583790.837743:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313443840 00000100:00100000:3.0:1789583790.837752:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313443840 00000100:00080000:2.0:1789583790.837784:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583790.837838:0:8280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:2.0:1789583790.837850:0:8280:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+6:2357:x1876514313443840:12345-192.168.203.46@tcp:39:umount.0 00000020:00000080:2.0:1789583790.837896:0:8280:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2edc 00000020:00010000:2.0:1789583790.837905:0:8280:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88b6620e4800: total 0 00000100:00080000:2.0:1789583790.837911:0:8280:0:(import.c:65:import_set_state_nolock()) ffff88b6620e1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789583790.837943:0:8280:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1789583790.838027:0:5836:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88b6620e4800: total 0 00010000:00010000:3.0:1789583790.838032:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583790.838092:0:5836:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88b6620e4800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789583790.838129:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4d00) 00010000:00010000:3.0:1789583790.838132:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583790.838143:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55800/0x6d3e73d72c6e3dfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6770 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583790.838179:0:5836:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88b6620e4800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789583790.838189:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583790.838191:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583790.838192:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583790.838231:0:8280:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7452e9e9-4caa-4b5a-b84c-d7e502425f35+3:2357:x1876514313443840:12345-192.168.203.46@tcp:39:umount.0 Request processed in 383us (566us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789583790.838240:0:8280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 240 00000100:00100000:2.0:1789583790.879080:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583790.879164:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444096 00000100:00100000:3.0:1789583790.879183:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444096 00000100:00100000:3.0:1789583790.879245:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 297 00000100:00100000:3.0:1789583790.879256:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+7:2357:x1876514313444096:12345-192.168.203.46@tcp:251:umount.0 00000020:00000080:3.0:1789583790.879298:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2dd2 00000020:00010000:3.0:1789583790.879306:0:5842:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88b675259800: total 0 00000100:00080000:3.0:1789583790.879311:0:5842:0:(import.c:65:import_set_state_nolock()) ffff88b675258800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789583790.879389:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b648d4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b5c501b0-a566-4083-bb80-bae594ae6290+3:2357:x1876514313444096:12345-192.168.203.46@tcp:251:umount.0 Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583790.879397:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 297 00000020:00010000:0.0:1789583790.880338:0:7652:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88b675259800: total 0 00010000:00010000:0.0:1789583790.880424:0:7652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88b675259800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789583790.880474:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216f800/0x6d3e73d72c6e2e88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6309 expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583790.880509:0:7652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88b675259800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789583790.880521:0:7652:0:(genops.c:885:class_export_put()) final put ffff88b675259800/b5c501b0-a566-4083-bb80-bae594ae6290 00010000:00010000:0.0:1789583790.880549:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583790.880552:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583790.880554:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789583790.880621:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b675259800/b5c501b0-a566-4083-bb80-bae594ae6290 for MGS 00000020:00000080:2.0:1789583790.880667:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b675258800 for MGS 00000100:00100000:1.0:1789583791.144431:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332292864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789583791.144532:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583791.147395:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292864 00000100:00100000:3.0:1789583791.147419:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292864 00000100:00100000:3.0:1789583791.147499:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789583791.147511:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332292864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583791.147571:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583791.147847:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332292864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 337us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583791.147855:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789583791.148473:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332292864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789583791.657138:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789583791.716357:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1789583791.716385:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000001:00080000:1.0:1789583791.716392:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789583791.716396:0:5871:0:(genops.c:885:class_export_put()) final put ffff88b6620e4800/7452e9e9-4caa-4b5a-b84c-d7e502425f35 00000001:00080000:1.0:1789583791.716416:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1789583791.716428:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000001:00080000:1.0:1789583791.716445:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1789583791.716448:0:5871:0:(genops.c:885:class_export_put()) final put ffff88b675259000/768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:1.0:1789583791.716464:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b6620e4800/7452e9e9-4caa-4b5a-b84c-d7e502425f35 for lustre-MDT0000 00000020:00000080:1.0:1789583791.716530:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b675259000/768b736a-7b4a-4614-9d07-b155a4183a8a for lustre-MDT0000 00000020:00000080:1.0:1789583791.716900:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b6620e1800 for lustre-MDT0000 00000020:00000080:1.0:1789583791.716908:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b674e39000 for lustre-MDT0000 00000001:00100000:0.0:1789583791.721299:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:0.0:1789583791.721309:0:6732:0:(genops.c:885:class_export_put()) final put ffff88b6751f6800/768b736a-7b4a-4614-9d07-b155a4183a8a 00000020:00000080:1.0:1789583791.721602:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b6751f6800/768b736a-7b4a-4614-9d07-b155a4183a8a for lustre-OST0000 00000020:00000080:1.0:1789583791.721728:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b6751f0800 for lustre-OST0000 00010000:00010000:3.0:1789583792.681890:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789583792.926512:0:13029:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789583792.965147:0:13029:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789583792.965232:0:13029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.965255:0:13029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.965262:0:13029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.965269:0:13029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.965302:0:13029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789583792.965309:0:13029:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789583792.965342:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789583792.965348:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789583792.965355:0:13029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789583792.965389:0:13029:0:(import.c:65:import_set_state_nolock()) ffff88b67bae8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789583792.965524:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583792.965533:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.965564:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02800 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583792.965568:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.965577:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583792.965584:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583792.965590:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789583792.965593:0:7652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789583792.965596:0:7652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789583792.965625:0:7652:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.965633:0:7652:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583792.965671:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.965679:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b645a02800/0x6d3e73d72c6e2e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.965695:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583792.965697:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583792.965699:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583792.965827:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583792.965854:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332293120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583792.965949:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583792.966086:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332292992:0@lo:39:umount.0 00000100:00100000:3.0:1789583792.966173:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583792.966242:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293120 00000100:00100000:0.0:1789583792.966254:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293120 00000100:00100000:0.0:1789583792.966341:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583792.966353:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+19:3307:x1876514332293120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583792.966381:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583792.966402:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cb600/0x6d3e73d72c6e2e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e57 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.966420:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583792.966484:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:3307:x1876514332293120:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583792.966492:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789583792.966621:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332293120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583792.966650:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332292992 00000100:00100000:1.0:1789583792.966658:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332292992 00000100:00100000:1.0:1789583792.966786:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789583792.966795:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876514332292992:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789583792.967751:0:5850:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2bef 00000100:00080000:1.0:1789583792.967953:0:5850:0:(import.c:65:import_set_state_nolock()) ffff88b6445de800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789583792.968089:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3304:x1876514332292992:12345-0@lo:39:umount.0 Request processed in 1294us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583792.968099:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00080000:0.0:1789583792.968383:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b67bae8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789583792.968402:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332292992:0@lo:39:umount.0 00000020:00000080:1.0:1789583792.968575:0:5850:0:(genops.c:885:class_export_put()) final put ffff88b6445d9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789583792.968645:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b6445d9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:3.0:1789583792.968710:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789583792.968724:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b6445de800 for lustre-MDT0000 00000100:00080000:3.0:1789583792.968756:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789583792.968764:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789583792.968771:0:13029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789583792.970261:0:13029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970283:0:13029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970292:0:13029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970307:0:13029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970331:0:13029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583792.970338:0:13029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970345:0:13029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970351:0:13029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970356:0:13029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970376:0:13029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789583792.970385:0:13029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970392:0:13029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970399:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789583792.970400:0:13029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970415:0:13029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970424:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970463:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02e00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583792.970469:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970475:0:13029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789583792.970482:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970486:0:13029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583792.970504:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583792.970512:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789583792.970512:0:13029:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583792.970524:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789583792.970534:0:13029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970541:0:13029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583792.970549:0:13029:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789583792.970553:0:13029:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789583792.970560:0:13029:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1789583792.970568:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970578:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1789583792.970590:0:13029:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789583792.970597:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789583792.970602:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1789583792.970609:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789583792.970610:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789583792.970623:0:13029:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff88b67525f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789583792.970631:0:13029:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff88b66de3f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789583792.970640:0:13029:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff88b650933380) has exports, disconnecting them 00000020:00080000:2.0:1789583792.970653:0:13029:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88b67525f000), last request at 1789583790 00010000:00010000:3.0:1789583792.970656:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b645a02e00/0x6d3e73d72c6e2e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e6c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789583792.970662:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2d54 00010000:00010000:3.0:1789583792.970684:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789583792.970689:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789583792.970693:0:13029:0:(import.c:65:import_set_state_nolock()) ffff88b67525d800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789583792.970697:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02c00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583792.970703:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970712:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583792.970725:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583792.970731:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789583792.970734:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789583792.970737:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789583792.970754:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789583792.970759:0:13029:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88b67525f000): rc 0 00000020:00000080:2.0:1789583792.970767:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67525f000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1789583792.970770:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789583792.970777:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970787:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b645a02c00/0x6d3e73d72c6e2d8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2d93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789583792.970792:0:13029:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88b66de3f000), last request at 1789583790 00000020:00000080:2.0:1789583792.970802:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2c89 00000100:00080000:2.0:1789583792.970846:0:13029:0:(import.c:65:import_set_state_nolock()) ffff88b676cd0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789583792.970863:0:13029:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88b66de3f000): rc 0 00000020:00000080:2.0:1789583792.970866:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b66de3f000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:3.0:1789583792.970872:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00000080:2.0:1789583792.970877:0:13029:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab7801c5bae0 00010000:00010000:3.0:1789583792.970879:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970892:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6752cbe00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583792.970895:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970902:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789583792.970908:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 10000000:00010000:3.0:1789583792.970909:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583792.970918:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 10000000:01000000:3.0:1789583792.970926:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789583792.970930:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789583792.970932:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000004:00080000:2.0:1789583792.970937:0:13029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1789583792.970951:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970959:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789583792.970980:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970988:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752cbe00/0x6d3e73d72c6e3080 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e3087 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.970999:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583792.971003:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.971016:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f000 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583792.971019:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789583792.971026:0:13029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1789583792.971027:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583792.971040:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583792.971046:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789583792.971048:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789583792.971052:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1789583792.971053:0:13029:0:(import.c:65:import_set_state_nolock()) ffff88b6620e0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789583792.971070:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00010000:00010000:3.0:1789583792.971071:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583792.971074:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:3.0:1789583792.971087:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:2.0:1789583792.971090:0:13029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:3.0:1789583792.971098:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.971107:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b68216f000/0x6d3e73d72c6e2b40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2b47 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.971121:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583792.971123:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583792.971125:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583792.971145:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332293376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583792.971240:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332293248:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789583792.971305:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67525f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789583792.971347:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66de3f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1789583792.971358:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789583792.971384:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b67525d800 for lustre-MDT0000 00000020:00000080:0.0:1789583792.971394:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b676cd0000 for lustre-MDT0000 00000100:00100000:0.0:1789583792.971415:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583792.971483:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332293760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583792.971491:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293376 00000100:00100000:0.0:1789583792.971502:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293376 00000100:00100000:3.0:1789583792.971534:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583792.971570:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583792.971573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293248 00000100:00100000:0.0:1789583792.971578:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293248 00000100:00100000:3.0:1789583792.971579:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332293504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583792.971598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293760 00000100:00100000:0.0:1789583792.971603:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293760 00000100:00100000:3.0:1789583792.971610:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583792.971636:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293504 00000100:00100000:0.0:1789583792.971644:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293504 00000100:00100000:3.0:1789583792.971660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789583792.971674:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+21:3306:x1876514332293376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789583792.971690:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583792.971707:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cb800/0x6d3e73d72c6e2d93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2d8c expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583792.971725:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583792.971770:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3306:x1876514332293376:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (417us total) trans 0 rc 0/0 00010000:00010000:1.0:1789583792.971800:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789583792.972351:0:13029:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789583792.972371:0:13029:0:(import.c:65:import_set_state_nolock()) ffff88b674e3f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789583792.972411:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff88b650933380) has no exports 00000100:00100000:2.0:1789583792.972493:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332293376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789583792.972548:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583792.972559:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332293632:0@lo:9:umount.0 00000100:00100000:2.0:1789583792.972608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583792.972632:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332293888:0@lo:9:umount.0 00000100:00100000:2.0:1789583792.972653:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583792.972705:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293632 00000100:00100000:2.0:1789583792.972710:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293632 00000100:00100000:2.0:1789583792.972834:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332293888 00000100:00100000:2.0:1789583792.972838:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332293888 00000100:00100000:2.0:1789583792.972865:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789583792.972888:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876514332293632:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789583792.972917:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2cd6 00000100:00080000:2.0:1789583792.972925:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b676cd0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789583792.972964:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789583792.976380:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1876514332293632:12345-0@lo:9:umount.0 Request processed in 2860us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583792.976401:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789583792.976444:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789583792.976459:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876514332293888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789583792.976494:0:6702:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2dcb 00000100:00080000:2.0:1789583792.976508:0:6702:0:(import.c:65:import_set_state_nolock()) ffff88b674e3e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789583792.976562:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789583792.976881:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789583792.976903:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+20:3305:x1876514332293248:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789583792.976907:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1789583792.976940:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583792.976970:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cb200/0x6d3e73d72c6e2e6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e65 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.976994:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583792.976997:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789583792.977027:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789583792.977032:0:5844:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583792.977068:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+18:3305:x1876514332293248:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (5652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583792.977077:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789583792.977118:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789583792.977132:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+17:3308:x1876514332293760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583792.977142:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583792.977164:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b640031000/0x6d3e73d72c6e2b47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2b40 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789583792.977182:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6620e0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1789583792.977183:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1789583792.977204:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789583792.977210:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789583792.977215:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332293632:0@lo:9:umount.0 00000100:00100000:0.0:1789583792.977231:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+16:3308:x1876514332293760:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (5696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583792.977239:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789583792.977253:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789583792.977260:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+15:3308:x1876514332293504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583792.977268:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583792.977277:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3087 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e3080 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583792.977290:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583792.977327:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b+14:3308:x1876514332293504:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (5716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583792.977346:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789583792.977416:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3305:1876514332293248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583792.977452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332293504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583792.977461:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3308:1876514332293760:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789583792.977681:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583792.979350:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3304:x1876514332293888:12345-0@lo:9:umount.0 Request processed in 2888us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583792.979364:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789583792.989847:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b674e3f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789583792.989872:0:3304:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789583792.989879:0:3304:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789583792.989889:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332293888:0@lo:9:umount.0 00000020:00080000:3.0:1789583792.999925:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff88b650933380) has no exports 00000020:00000080:3.0:1789583793.067557:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b9b 00000020:00000080:3.0:1789583793.067591:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b66e241000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789583793.067611:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789583793.067697:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789583793.067715:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789583793.067722:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff88b67c4b8000) has no exports 00000020:00000080:0.0:1789583793.067954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66e241000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789583793.068187:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b94 00000020:00000080:2.0:1789583793.068194:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67c4fd000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789583793.068322:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789583793.068334:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789583793.068338:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67baf8000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789583793.068341:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baf8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789583793.068350:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1789583793.068941:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67c4fd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789583793.069129:0:13029:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b644d73a20 - data ffff88b65e712438/ffff88b675256800 00000020:01000000:3.0:1789583793.069355:0:13029:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b6430f6660 - data ffff88b667f76000/ffff88b6763a5800 00000001:00000004:0.0:1789583793.081554:0:13029:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1789583793.172136:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789583793.172163:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1789583793.172180:0:13029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789583793.172182:0:13029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789583793.173010:0:7125:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789583793.173017:0:7125:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789583793.173031:0:7125:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1789583793.174914:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789583793.174925:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1789583793.174957:0:13029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789583793.174961:0:13029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789583793.175799:0:8111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789583793.175829:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1789583793.175843:0:8111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789583793.230347:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b63 00000020:00000080:3.0:1789583793.230363:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67baea800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789583793.231861:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b78 00000020:00000080:3.0:1789583793.231877:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67bafd800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789583793.231886:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789583793.231894:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583793.231905:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789583793.231910:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff88b650930000) has no exports 00000004:01000000:3.0:1789583793.232107:0:13029:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789583793.232117:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2db6 00000020:00000080:3.0:1789583793.232122:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b66d1cd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789583793.232127:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789583793.232130:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583793.232138:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789583793.232141:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff88b67c4bcd40) has no exports 00000020:00000080:3.0:1789583793.232162:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2daf 00000020:00000080:3.0:1789583793.232167:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b674e3f000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789583793.232650:0:13029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789583793.232657:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789583793.232663:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789583793.232670:0:13029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789583793.232674:0:13029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789583793.232727:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583793.232735:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789583793.232742:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2ccf 00000020:00000080:3.0:1789583793.232747:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b676cd6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789583793.232751:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789583793.232754:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583793.232757:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789583793.232760:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff88b67c4b99c0) has no exports 00000020:00000080:3.0:1789583793.232765:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2cc8 00000020:00000080:3.0:1789583793.232768:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b6620e6800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789583793.233122:0:13029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789583793.233125:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789583793.233128:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789583793.233131:0:13029:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789583793.233132:0:13029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789583793.233532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789583793.233570:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67bafd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789583793.233577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66d1cd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789583793.233582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b674e3f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789583793.233587:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b674e3f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789583793.233597:0:36:0:(genops.c:885:class_export_put()) final put ffff88b6620e3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789583793.233599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b6620e3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789583793.233604:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789583793.233695:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b676cd6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789583793.233700:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b6620e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789583793.233705:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b6620e0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789583793.234449:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583793.234464:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789583793.234470:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b66220e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789583793.234473:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66220e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789583793.234480:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789583793.235066:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583793.235073:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789583793.235078:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67baef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789583793.235081:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baef000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789583793.235087:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789583793.235211:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b7f 00000020:00000080:3.0:1789583793.235219:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67baf9000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789583793.235280:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789583793.235286:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583793.235291:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789583793.235296:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff88b6509319c0) has no exports 00000020:00000080:3.0:1789583793.235333:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583793.235337:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789583793.235342:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b86 00000020:00000080:3.0:1789583793.235346:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67bafa000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789583793.235707:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baf9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789583793.235714:0:36:0:(genops.c:885:class_export_put()) final put ffff88b67baee800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789583793.235716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789583793.235724:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1789583793.236194:0:13029:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b666645000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789583793.236200:0:13029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b666645000 3 00000020:01000004:3.0:1789583793.236204:0:13029:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88b666645000 from lustre-MDT0000 00000020:00000080:3.0:1789583793.236233:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583793.236240:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789583793.236243:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67baed800/lustre-MDT0000_UUID 00000020:00000080:3.0:1789583793.236246:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baed800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789583793.236257:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789583793.236292:0:13029:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789583793.236296:0:13029:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789583793.236299:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789583793.236303:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583793.236306:0:13029:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789583793.236314:0:13029:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff88b662368000 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789583793.236321:0:13029:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff88b662298000) has exports, disconnecting them 00000020:00080000:3.0:1789583793.236327:0:13029:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff88b662368000), last request at 1789583586 00000020:00000080:3.0:1789583793.236347:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b24 00000020:00010000:3.0:1789583793.236352:0:13029:0:(genops.c:1920:obd_stale_export_put()) Put export ffff88b662368000: total 1 00000100:00080000:3.0:1789583793.236358:0:13029:0:(import.c:65:import_set_state_nolock()) ffff88b66236b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789583793.236379:0:13029:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88b662368000): rc 0 00000020:00080000:3.0:1789583793.236383:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff88b662298000) has no exports 00000100:00100000:3.0:1789583793.236452:0:5842:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff88b648dd5c00:5842] 1 exiting: rc = 0 00000020:00010000:2.0:1789583793.236719:0:7652:0:(genops.c:1906:obd_stale_export_get()) Get export ffff88b662368000: total 1 00010000:00010000:2.0:1789583793.236764:0:7652:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff88b662368000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789583793.236798:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfb000/0x6d3e73d72c6e306b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e3064 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236856:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752ca800/0x6d3e73d72c6e3079 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e3072 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236872:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641482400/0x6d3e73d72c6e2c3c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2c35 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236886:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216ec00/0x6d3e73d72c6e2e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e73 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236898:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b68216f200/0x6d3e73d72c6e2e26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e1f expref: 5 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236910:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6752cae00/0x6d3e73d72c6e2e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e2d expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236920:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a02200/0x6d3e73d72c6e2e42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e3b expref: 3 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236930:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b645a03a00/0x6d3e73d72c6e2e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d3e73d72c6e2e49 expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583793.236941:0:7652:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff88b662368000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789583793.236955:0:7652:0:(genops.c:885:class_export_put()) final put ffff88b662368000/02f837f8-2cf9-4adc-83b5-f9d00ec75b7b 00010000:00010000:2.0:1789583793.236963:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583793.236965:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583793.236966:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583793.237131:0:5843:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff88b648dd4800:5843] 2 exiting: rc = 0 00000020:00000080:1.0:1789583793.237204:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67bafa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789583793.237212:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b662368000/02f837f8-2cf9-4adc-83b5-f9d00ec75b7b for MGS 00000020:00000080:1.0:1789583793.237257:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b66236b800 for MGS 00000100:00100000:0.0:1789583793.237413:0:5841:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff88b648c8ea00:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1789583793.238263:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238274:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238280:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238286:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238293:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238301:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238321:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238327:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238334:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238339:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238346:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238352:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238358:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238366:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238373:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238380:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238386:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238392:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238399:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238406:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238412:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238419:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238424:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238430:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238436:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238442:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238449:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238455:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238461:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238466:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238473:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238479:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238485:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238491:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238497:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238503:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238509:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238515:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238520:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238525:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238530:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.238543:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239323:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239337:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239343:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239350:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239357:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239364:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239370:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239377:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239384:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239391:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239398:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239405:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239413:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239419:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239425:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239432:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239438:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239444:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239451:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239458:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239464:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.239472:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789583793.240766:0:13029:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789583793.240775:0:13029:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1789583793.242325:0:13029:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b668fb85a0 - data ffff88b67fc97948/ffff88b67fb7b400 00000020:01000000:2.0:1789583793.242479:0:13029:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b64356b8a0 - data ffff88b667f456c0/ffff88b645aa4c00 00000020:00000080:2.0:1789583793.247609:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b08 00000020:00000080:2.0:1789583793.247624:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b649ebd000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789583793.247663:0:13029:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b666645000 from MGS, refs=2 00000020:01000004:2.0:1789583793.247668:0:13029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b666645000 2 00000020:01000004:2.0:1789583793.247671:0:13029:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88b666645000 from MGS 00000020:00000080:2.0:1789583793.247701:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789583793.247711:0:13029:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1789583793.247713:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b65120b800/MGS 00000020:00000080:2.0:1789583793.247717:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b65120b800/MGS for MGS 00000020:01000000:2.0:1789583793.247725:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1789583793.248190:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1789583793.248196:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789583793.248203:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789583793.248212:0:13029:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff88b67baef800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789583793.248219:0:13029:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff88b67c4bb380) has exports, disconnecting them 00000020:00080000:2.0:1789583793.248225:0:13029:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff88b67baef800), last request at 1789583587 00000020:00000080:2.0:1789583793.248230:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2bd3 00000020:00080000:2.0:1789583793.248241:0:13029:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88b67baef800): rc 0 00000020:00000080:2.0:1789583793.248246:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67baef800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789583793.248648:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b649ebd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789583793.248660:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67baef800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1789583793.250012:0:13029:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1789583793.250273:0:13029:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789583793.250279:0:13029:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789583793.250287:0:13029:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789583793.250329:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b67bae8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789583793.250528:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583793.250539:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789583793.250546:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b67c4ff000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789583793.251118:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67c4ff000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789583793.251158:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1789583793.251244:0:13029:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b666645000 1 00000020:00000080:3.0:1789583793.251252:0:13029:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2afa 00000020:00000080:3.0:1789583793.251261:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b65120f000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1789583793.251282:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1789583793.251289:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583793.251296:0:13029:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789583793.251301:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff88b650934d40) has no exports 00000020:00000080:1.0:1789583793.251414:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b65120f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789583793.353456:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789583793.353478:0:13029:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789583793.353486:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b645674000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789583793.353501:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b645674000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789583793.353513:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789583793.353688:0:13029:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88b666640800 00000020:01000000:2.0:1789583793.353716:0:13029:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1789583793.353721:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789583793.353727:0:13029:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789583793.353732:0:13029:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff88b648deb380) has no exports 00000100:00100000:2.0:1789583793.353880:0:8280:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff88b645b24200:8280] 3 exiting: rc = 0 00000100:00100000:1.0:1789583793.354161:0:5848:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff88b648888200:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1789583793.354243:0:5850:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff88b648cfb000:5850] 2 exiting: rc = 0 00000100:00100000:2.0:1789583793.354341:0:5849:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff88b648cfb200:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1789583793.354426:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354532:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354540:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354547:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354562:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354570:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354577:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354586:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354596:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354603:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354609:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354615:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354620:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354626:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354632:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354638:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354644:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354650:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354657:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354664:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354669:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354676:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354683:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354688:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354695:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354700:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354706:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354712:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354719:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354724:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354731:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354736:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354741:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354747:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354752:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354766:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354772:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354778:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354784:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354789:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354795:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.354802:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355199:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355208:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355217:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355225:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355234:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355242:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355250:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355471:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355481:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355487:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355544:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355555:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355564:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355572:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355580:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355589:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355597:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355605:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355613:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355622:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355630:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.355649:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.361545:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88b648cfa400:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789583793.361700:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88b648cfbe00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1789583793.361917:0:11497:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff88b541986200:11497] 2 exiting: rc = 0 00000100:00100000:3.0:1789583793.362180:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362192:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362199:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362206:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362213:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362219:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362240:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362252:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362334:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362343:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362353:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362363:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362373:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362381:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362389:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362398:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362406:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362414:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362422:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362430:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362439:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362447:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362456:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362464:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362471:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362484:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362502:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362507:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362513:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362525:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362532:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362538:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362543:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362555:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362563:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362568:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362574:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362580:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362586:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362593:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362599:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362605:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362610:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362616:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362621:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362627:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362633:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362639:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362644:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362650:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362656:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362661:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362668:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362674:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362681:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362686:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362731:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362741:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362748:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362755:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362762:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362779:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362788:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.362796:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.368140:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff88b665c27200:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1789583793.368475:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff88b665c27c00:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1789583793.368949:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.368966:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.368985:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.368994:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369001:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369009:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369016:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369023:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369030:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369037:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369045:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369069:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369078:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369085:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369092:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369099:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369106:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369113:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369120:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369127:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369135:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369142:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369159:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369181:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369190:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369197:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369204:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369211:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369224:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369232:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369240:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369252:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369283:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369290:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369298:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369319:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369328:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369335:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369342:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369349:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369356:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369363:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369371:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369378:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369388:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369395:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369402:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369424:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369432:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369463:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369517:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369574:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369581:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369588:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369606:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369622:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369639:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369646:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369661:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369695:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369709:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369716:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369723:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583793.369735:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385375:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88b651160400:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789583793.385672:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88b665c26000:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1789583793.385774:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385797:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385830:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385838:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385845:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385850:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385857:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385862:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385868:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385873:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385879:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385884:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385888:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385894:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385899:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385903:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385908:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385913:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385918:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385922:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385926:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385931:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385936:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385941:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385946:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385950:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385955:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.385960:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386217:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386225:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386230:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386235:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386240:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386245:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386251:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386263:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386276:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386282:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386288:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386293:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386298:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386303:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386308:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386313:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386318:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386324:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386329:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386335:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386339:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386344:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386349:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386354:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386359:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386364:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386369:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386374:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386379:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386383:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386388:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386393:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386398:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386403:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386408:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.386414:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.388876:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88b648896200:5858] 1 exiting: rc = 0 00000100:00100000:2.0:1789583793.389029:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88b665c27400:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1789583793.389092:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389100:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389105:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389110:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389116:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389136:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389142:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389161:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389168:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389174:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389180:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389187:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389192:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389198:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389204:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389211:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389218:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389224:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389231:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389237:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389243:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389250:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389262:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389268:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389274:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389279:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389285:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389291:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389297:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389303:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389308:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389314:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389320:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389326:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389335:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389344:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389350:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389358:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389367:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389375:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389390:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389398:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389406:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389414:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389422:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389431:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389439:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389447:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389455:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389465:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389474:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389481:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389488:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389670:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389676:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389682:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389688:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389695:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389701:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389708:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389714:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389719:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389725:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.389731:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390198:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff88b651161600:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1789583793.390712:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff88b648896e00:5859] 0 exiting: rc = 1 00000100:00100000:2.0:1789583793.390777:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390784:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390790:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390796:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390802:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390833:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390839:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390846:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390852:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390870:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390876:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390881:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390887:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390893:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390899:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390905:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390911:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390916:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390922:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390928:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390934:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390940:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390946:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390951:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390957:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390962:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390968:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390973:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390978:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390984:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390989:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.390995:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391000:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391006:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391012:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391017:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391022:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391028:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391034:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391040:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391045:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391051:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391056:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391062:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391074:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391079:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391085:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391090:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391096:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391102:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391107:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391113:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391118:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391124:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391130:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391136:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391141:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391158:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391165:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391170:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391178:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391184:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391189:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.391194:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.394223:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff88b648847800:5861] 0 exiting: rc = 1 00000100:00100000:2.0:1789583793.394743:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff88b648847a00:5862] 1 exiting: rc = 0 00000100:00100000:2.0:1789583793.394995:0:5863:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff88b648847400:5863] 2 exiting: rc = 0 00000100:00100000:2.0:1789583793.395063:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395073:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395081:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395088:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395095:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395103:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395110:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395117:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395124:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395130:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395137:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395175:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395201:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395208:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395216:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395222:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395229:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395236:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395243:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395250:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395367:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395375:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395382:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395389:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395395:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395894:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395903:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395910:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395916:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395923:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395929:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395935:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395941:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395948:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395955:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395983:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395992:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.395999:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396006:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396013:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396019:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396026:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396033:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396041:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396049:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396055:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396062:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396079:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396087:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396094:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396101:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396108:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396115:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396122:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396129:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396136:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396143:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396161:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396169:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396176:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396182:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396190:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396196:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583793.396212:0:13029:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789583793.403966:0:13029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789583793.403982:0:13029:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789583793.403989:0:13029:0:(genops.c:885:class_export_put()) final put ffff88b66220d800/MDS_uuid 00000020:00000080:2.0:1789583793.403995:0:13029:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66220d800/MDS_uuid for MDS 00000020:01000000:2.0:1789583793.404003:0:13029:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789583793.404181:0:13029:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1789583793.732894:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789583794.791384:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789583794.791396:0:7663:0:(genops.c:885:class_export_put()) final put ffff88b674e3d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789583794.791433:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88b674e3d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789583794.791484:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b674e3e000 for lustre-OST0001 00010000:00010000:3.0:1789583794.791621:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583795.762170:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583795.762193:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332294016:0@lo:400:kworker.0 00000400:00000100:0.0:1789583795.762243:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514332294016 offset 0 length 224: 4 00000100:00100000:0.0:1789583795.762430:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332294144:0@lo:400:kworker.0 00000400:00000100:0.0:1789583795.762451:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332294144 offset 0 length 224: 4 00000100:00100000:0.0:1789583795.762495:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332294272:0@lo:400:kworker.0 00000400:00000100:0.0:1789583795.762514:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332294272 offset 0 length 224: 4 00010000:00010000:1.0:1789583795.815969:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789583796.482309:0:13180:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789583796.497345:0:13180:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789583796.497410:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583796.497428:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583796.497436:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583796.497444:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583796.497704:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789583796.497712:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789583796.497961:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789583796.497977:0:13180:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b6752a3800 x1876514332294144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583796.497998:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789583796.498006:0:13180:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789583796.498039:0:13180:0:(import.c:65:import_set_state_nolock()) ffff88b66de38800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789583796.498381:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332294144:0@lo:400:kworker.0 00000100:00100000:0.0:1789583796.499007:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876514332294400:0@lo:39:umount.0 00000400:00000100:0.0:1789583796.499098:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332294400 offset 0 length 224: 4 00010000:00010000:0.0:1789583796.499188:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583796.499197:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583796.499209:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfac00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583796.499214:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583796.499225:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583796.499234:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583796.499240:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789583796.499243:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789583796.499247:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789583796.499284:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583796.499290:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583796.499321:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583796.499328:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfac00/0x6d3e73d72c6e2e3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d3e73d72c6e2e42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583796.499341:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583796.499342:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583796.499353:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583796.499375:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789583796.499387:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332294528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583796.499427:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583796.501024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332294528 00000100:00100000:1.0:1789583796.501045:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332294528 00000100:00100000:1.0:1789583796.501135:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789583796.501146:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1876514332294528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789583796.501156:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789583796 with bad export cookie 7871856566690786084 00000100:00100000:2.0:1789583796.509967:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3307:x1876514332294528:12345-0@lo:103:ldlm_bl.0 Request processed in 8809us (10526us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789583796.509986:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789583796.510118:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.146@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789583796.510135:0:3307:0:(import.c:65:import_set_state_nolock()) ffff88b66220f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789583796.510139:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.146@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789583796.516673:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.146@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789583796.516680:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789583796.516693:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b6752a2a00 x1876514332294016/t0(0) o400->MGC192.168.203.146@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789583811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583796.516983:0:3307:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b6752a3800 x1876514332294528/t0(0) o103->MGC192.168.203.146@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789583812 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789583796.516995:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789583796.516998:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789583796.517000:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789583796.517005:0:3307:0:(import.c:65:import_set_state_nolock()) ffff88b66220f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789583796.517011:0:3307:0:(import.c:545:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 143 00000100:00080000:2.0:1789583796.517030:0:3307:0:(import.c:666:import_select_connection()) MGC192.168.203.146@tcp: import ffff88b66220f800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583796.517072:0:3307:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763cb100 x1876514332294656/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789583796.517114:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3307:1876514332294528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789583796.517243:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3304:1876514332294656:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1789583796.517319:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514332294656 offset 0 length 520: 4 00000100:00100000:0.0:1789583796.521183:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3306:1876514332294016:0@lo:400:kworker.0 00000001:00100000:1.0:1789583796.824492:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789583796.824523:0:6732:0:(genops.c:885:class_export_put()) final put ffff88b676cd2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789583796.825333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b676cd2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789583796.825396:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b676cd0800 for lustre-OST0000 00010000:00010000:3.0:1789583796.839282:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583797.864197:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583798.886993:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583799.913937:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583800.871513:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789583800.871523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789583800.871683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789583800.871707:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332294784:0@lo:400:kworker.0 00000400:00000100:2.0:1789583800.871762:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332294784 offset 0 length 224: 4 00010000:00010000:1.0:1789583800.935167:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583801.895100:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789583801.895110:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789583801.895216:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332294912:0@lo:400:kworker.0 00000400:00000100:2.0:1789583801.895282:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332294912 offset 0 length 224: 4 00010000:00010000:0.0:1789583801.959034:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583802.983766:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583804.007011:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583805.031120:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583806.055228:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583807.015124:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789583807.015135:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789583807.015303:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583807.015325:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332295040:0@lo:400:kworker.0 00000100:00100000:3.0:1789583807.015333:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583796/real 1789583796] req@ffff88b6763cb100 x1876514332294656/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789583806 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583807.015355:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b6763cb100 x1876514332294656/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789583806 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583807.015366:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583796/real 1789583796] req@ffff88b67c5f1f80 x1876514332294400/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789583806 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000400:00000100:0.0:1789583807.018918:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332295040 offset 0 length 224: 4 00000100:00100000:3.0:1789583807.020442:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b67c5f1f80 x1876514332294400/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789583806 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789583807.020469:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b66220f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789583807.020494:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789583807.020499:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3304:1876514332294656:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1789583807.020505:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b66de38800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789583807.020524:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876514332294400:0@lo:39:umount.0 00000100:00080000:1.0:1789583807.020612:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789583807.020618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789583807.020621:0:37:0:(import.c:65:import_set_state_nolock()) ffff88b66220f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789583807.020626:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 353 00000100:00080000:1.0:1789583807.020631:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.146@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789583807.020654:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.146@tcp: import ffff88b66220f800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789583807.020692:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67c5f0a80 x1876514332295168/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789583807.020705:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789583807.020710:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789583807.020716:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1789583807.020740:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3304:1876514332295168:0@lo:250:kworker.0 00000400:00000100:3.0:1789583807.020916:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876514332295168 offset 0 length 520: 4 00010000:00010000:0.0:1789583807.021654:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021666:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021674:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021681:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021707:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583807.021728:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021735:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021740:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021746:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583807.021767:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789583807.021771:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789583807.021797:0:13180:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789583807.021801:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789583807.021829:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789583807.021835:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789583807.021839:0:13180:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff88b648decd40) has no exports 00000020:00080000:0.0:1789583807.021863:0:13180:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff88b648decd40) has no exports 00010000:00010000:1.0:1789583807.024432:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789583807.024445:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024456:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b645a02600 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583807.024459:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024491:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583807.024498:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583807.024504:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789583807.024506:0:7652:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789583807.024509:0:7652:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789583807.024524:0:7652:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:1.0:1789583807.024528:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024535:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b645a02600/0x6d3e73d72c6e2e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024549:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583807.024553:0:7652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024559:0:7652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0c00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583807.024561:0:7652:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024568:0:7652:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583807.024573:0:7652:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583807.024588:0:7652:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789583807.024590:0:7652:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789583807.024593:0:7652:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789583807.024599:0:7652:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:1.0:1789583807.024602:0:7652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024607:0:7652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6756a0c00/0x6d3e73d72c6e3072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e3079 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583807.024616:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583807.024618:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583807.024619:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583807.024962:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789583807.028197:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b668fb8780 - data ffff88b67fc97af8/ffff88b67fb7b000 00000020:01000000:0.0:1789583807.028312:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b67515f2a0 - data ffff88b667f7e6c0/ffff88b54189cc00 00100000:10000000:0.0:1789583807.045351:0:13180:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00010000:00010000:1.0:1789583807.080662:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789583807.090548:0:13180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2c58 00000020:00000080:1.0:1789583807.090566:0:13180:0:(genops.c:885:class_export_put()) final put ffff88b66de3e000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789583807.090582:0:13180:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b64a171800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789583807.090586:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b64a171800 2 00000020:01000004:1.0:1789583807.090589:0:13180:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88b64a171800 from lustre-OST0000 00000020:00000080:1.0:1789583807.090612:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789583807.090622:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789583807.090624:0:13180:0:(genops.c:885:class_export_put()) final put ffff88b66de3c800/lustre-OST0000_UUID 00000020:00000080:1.0:1789583807.090627:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66de3c800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789583807.090634:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1789583807.090933:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66de3e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1789583807.091142:0:13180:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789583807.091149:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789583807.091153:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789583807.091229:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789583807.091238:0:13180:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff88b66de3f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789583807.091245:0:13180:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff88b67c5b3380) has exports, disconnecting them 00000020:00080000:1.0:1789583807.091262:0:13180:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff88b66de3f800), last request at 1789583603 00000020:00000080:1.0:1789583807.091266:0:13180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2c82 00000020:00080000:1.0:1789583807.091279:0:13180:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88b66de3f800): rc 0 00000020:00000080:1.0:1789583807.091285:0:13180:0:(genops.c:885:class_export_put()) final put ffff88b66de3f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789583807.091616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66de3f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789583807.092863:0:13180:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789583807.092870:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789583807.092874:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789583807.092880:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789583807.093015:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789583807.093022:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789583807.093027:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b64a171800 1 00000020:00000080:2.0:1789583807.093033:0:13180:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2c12 00000020:00000080:2.0:1789583807.093057:0:13180:0:(genops.c:885:class_export_put()) final put ffff88b64a6cb800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789583807.093061:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789583807.093065:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789583807.093069:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789583807.093073:0:13180:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff88b648de99c0) has no exports 00000020:00000080:3.0:1789583807.093258:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b66de38800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789583807.093265:0:37:0:(genops.c:885:class_export_put()) final put ffff88b676cd5000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789583807.093268:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b676cd5000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789583807.093285:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789583807.093333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff88b64a6cb800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789583807.120776:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789583807.120790:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789583807.120796:0:13180:0:(genops.c:885:class_export_put()) final put ffff88b64a173800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789583807.120800:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff88b64a173800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789583807.120825:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789583807.120964:0:13180:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88b64a174000 00000020:02000400:2.0:1789583807.121005:0:13180:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789583808.107300:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583809.128201:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789583809.889435:0:13332:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789583809.904393:0:13332:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789583809.904634:0:13332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583809.904648:0:13332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583809.904655:0:13332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583809.904662:0:13332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583809.904688:0:13332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789583809.904693:0:13332:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789583809.904716:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789583809.904727:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b6752a2300 x1876514332294272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583811 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583809.904775:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b67c5f0000 x1876514332294784/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583816 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583809.904792:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b67c5f0380 x1876514332294912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583817 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583809.904801:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b67c5f1180 x1876514332295040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583823 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583809.904843:0:13332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789583809.904849:0:13332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789583809.904873:0:13332:0:(import.c:65:import_set_state_nolock()) ffff88b67525b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1789583809.904881:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583809.904889:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583809.904898:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa000 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583809.904901:0:5837:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583809.904910:0:5837:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583809.904917:0:5837:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583809.904923:0:5837:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789583809.904925:0:5837:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789583809.904928:0:5837:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789583809.904938:0:5837:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:1.0:1789583809.904942:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583809.904948:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfa000/0x6d3e73d72c6e2e1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583809.904959:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583809.904967:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583809.904969:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583809.904993:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332295040:0@lo:400:kworker.0 00000100:00100000:0.0:1789583809.905020:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332294912:0@lo:400:kworker.0 00000100:00100000:0.0:1789583809.905037:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332294784:0@lo:400:kworker.0 00000100:00100000:3.0:1789583809.905185:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332294272:0@lo:400:kworker.0 00000100:00100000:3.0:1789583809.905208:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876514332295296:0@lo:39:umount.0 00000400:00000100:3.0:1789583809.905249:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876514332295296 offset 0 length 224: 4 00010000:00010000:2.0:1789583810.151141:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583811.175013:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789583812.135524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789583812.135533:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789583812.199109:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583813.224135:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583814.247049:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583815.271166:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583816.295360:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789583817.257604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789583817.257612:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789583817.319149:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583818.343915:0:5837:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583819.110940:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583809/real 1789583809] req@ffff88b6763ca680 x1876514332295296/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789583819 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583819.110981:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b6763ca680 x1876514332295296/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789583819 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789583819.110999:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b67525b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789583819.111016:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876514332295296:0@lo:39:umount.0 00000100:00080000:2.0:1789583819.111157:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789583819.111162:0:13332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789583819.111167:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789583819.112018:0:13332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112033:0:13332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112039:0:13332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112046:0:13332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112092:0:13332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583819.112099:0:13332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112105:0:13332:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112110:0:13332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112115:0:13332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583819.112134:0:13332:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789583819.112138:0:13332:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789583819.112158:0:13332:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789583819.112162:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789583819.112167:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789583819.112174:0:13332:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789583819.112178:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff88b675534d40) has no exports 00000020:00080000:2.0:1789583819.112200:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff88b675534d40) has no exports 00000020:01000000:2.0:1789583819.113792:0:13332:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b644d733c0 - data ffff88b64213ed80/ffff88b67b9c1c00 00000020:01000000:2.0:1789583819.113947:0:13332:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88b644d73f60 - data ffff88b65e6905e8/ffff88b675254800 00010000:00010000:3.0:1789583819.114082:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789583819.114090:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114101:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216fc00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583819.114105:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114114:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583819.114121:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583819.114126:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789583819.114143:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789583819.114146:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789583819.114162:0:5836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:3.0:1789583819.114165:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114172:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b68216fc00/0x6d3e73d72c6e2e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e34 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114186:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583819.114189:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114194:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:3.0:1789583819.114197:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114204:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583819.114210:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583819.114215:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789583819.114217:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789583819.114219:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789583819.114224:0:5836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:3.0:1789583819.114227:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114232:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6756a1200/0x6d3e73d72c6e3064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e306b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.114251:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583819.114252:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583819.114254:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583819.114319:0:7652:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789583819.128557:0:13332:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789583819.210344:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2d23 00000020:00000080:3.0:1789583819.210355:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b67552d000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789583819.210431:0:13332:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b66de3b000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789583819.210436:0:13332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b66de3b000 2 00000020:01000004:3.0:1789583819.210439:0:13332:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88b66de3b000 from lustre-OST0001 00000020:00000080:3.0:1789583819.210719:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583819.210729:0:13332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789583819.210732:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b67552b800/lustre-OST0001_UUID 00000020:00000080:3.0:1789583819.210735:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67552b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789583819.210977:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789583819.211098:0:13332:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b->MGS 00010000:00010000:3.0:1789583819.211114:0:13332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583819.211126:0:13332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583819.211133:0:13332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789583819.211136:0:13332:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789583819.211139:0:13332:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789583819.211151:0:13332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:3.0:1789583819.211155:0:13332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b640031c00/0x6d3e73d72c6e2c35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2c3c expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583819.211169:0:13332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789583819.211190:0:13332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583819.211195:0:13332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789583819.211198:0:13332:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789583819.211199:0:13332:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789583819.211282:0:13332:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff88b66220f800 00010000:00010000:3.0:1789583819.211285:0:13332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b6752ca000/0x6d3e73d72c6e2e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d3e73d72c6e2e7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789583819.211302:0:13332:0:(import.c:65:import_set_state_nolock()) ffff88b66220f800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789583819.211305:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789583819.211308:0:13332:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789583819.211309:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789583819.211314:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789583819.211324:0:13332:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff88b67c5f0a80 x1876514332295168/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789583822 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789583819.211345:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789583819.211348:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:1.0:1789583819.211405:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67552d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789583819.211603:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02f837f8-2cf9-4adc-83b5-f9d00ec75b7b:3304:1876514332295168:0@lo:250:kworker.0 10000000:01000000:3.0:1789583819.214790:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789583819.214832:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2b16 00000020:00000080:3.0:1789583819.214842:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b66220f000/02f837f8-2cf9-4adc-83b5-f9d00ec75b7b 00000020:01000000:3.0:1789583819.214867:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.146@tcp (flags='') 00000020:00000080:3.0:1789583819.214879:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583819.214886:0:13332:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.146@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789583819.214890:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff88b648de8000) has no exports 10000000:01000000:0.0:1789583819.214976:0:5845:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789583819.215331:0:13332:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.146@tcp: client import never connected 00000100:00080000:3.0:1789583819.215336:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789583819.215340:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789583819.215343:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789583819.215359:0:13332:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789583819.215400:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583819.215407:0:13332:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.146@tcp (uuid 02f837f8-2cf9-4adc-83b5-f9d00ec75b7b) 00000020:01000000:3.0:1789583819.215413:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789583819.215416:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583819.215420:0:13332:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789583819.215426:0:13332:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff88b67525c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789583819.215432:0:13332:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff88b675530000) has exports, disconnecting them 00000020:00080000:3.0:1789583819.215436:0:13332:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff88b67525c800), last request at 1789583621 00000020:00000080:3.0:1789583819.215440:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2d4d 00000020:00080000:3.0:1789583819.215451:0:13332:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff88b67525c800): rc 0 00000020:00000080:3.0:1789583819.215455:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b67525c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789583819.216800:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66220f000/02f837f8-2cf9-4adc-83b5-f9d00ec75b7b for MGC192.168.203.146@tcp 00000020:00000080:1.0:1789583819.216830:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b66220f800 for MGC192.168.203.146@tcp 00000020:00000080:1.0:1789583819.216837:0:36:0:(genops.c:885:class_export_put()) final put ffff88b66220b800/02f837f8-2cf9-4adc-83b5-f9d00ec75b7b 00000020:00000080:1.0:1789583819.216839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66220b800/02f837f8-2cf9-4adc-83b5-f9d00ec75b7b for MGC192.168.203.146@tcp 00000020:01000000:1.0:1789583819.216844:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.146@tcp (02f837f8-2cf9-4adc-83b5-f9d00ec75b7b) 00000020:00000080:1.0:1789583819.217102:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67525c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789583819.229861:0:13332:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789583819.229870:0:13332:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789583819.229874:0:13332:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789583819.229882:0:13332:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789583819.229996:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff88b67525b800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789583819.230070:0:5837:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789583819.230367:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789583819.230484:0:7652:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789583819.230652:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88b650f4f800:5831] 0 exiting: rc = 1 00000100:00100000:0.0:1789583819.230730:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88b650f4e600:5832] 1 exiting: rc = 0 00000100:00100000:3.0:1789583819.231094:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.231583:0:8527:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff88b6751e9e00:8527] 3 exiting: rc = 0 00000100:00100000:0.0:1789583819.231769:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88b6813cb200:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1789583819.231845:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88b651a9be00:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1789583819.232108:0:5835:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff88b6434d2800:5835] 2 exiting: rc = 0 00000100:00100000:3.0:1789583819.232160:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232168:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232173:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232178:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232183:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232188:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232193:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232200:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232205:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232212:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232217:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232223:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232228:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232247:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232253:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232259:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232266:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232270:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232275:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232281:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232286:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232291:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232297:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232303:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232308:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232314:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232319:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232324:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232330:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232336:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232341:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232345:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232351:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232357:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232362:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232368:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232374:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232379:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232384:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232390:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232395:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232401:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232406:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232411:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232417:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232422:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232428:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232434:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232447:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232452:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232458:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232463:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232468:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232473:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232478:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232483:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232488:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232492:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232497:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232503:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232508:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232513:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232518:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.232524:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789583819.236571:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789583819.236584:0:13332:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789583819.236590:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b67525a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789583819.236595:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67525a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789583819.236600:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789583819.236634:0:13332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b66de3b000 1 00000020:00000080:3.0:1789583819.236639:0:13332:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x6d3e73d72c6e2cf2 00000020:00000080:3.0:1789583819.236645:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b67510d000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789583819.236654:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789583819.236658:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789583819.236662:0:13332:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789583819.236666:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff88b66229b380) has no exports 00000020:00000080:1.0:1789583819.236833:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88b67510d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789583819.263627:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789583819.263643:0:13332:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789583819.263649:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b66d1cb800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789583819.263653:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff88b66d1cb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789583819.263667:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789583819.264939:0:13332:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88b66d1cc800 00000020:01000000:0.0:1789583819.266046:0:13332:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789583819.266055:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789583819.266060:0:13332:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789583819.266065:0:13332:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff88b67c5b0000) has no exports 00000020:00000080:0.0:1789583819.266089:0:13332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789583819.266098:0:13332:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789583819.266101:0:13332:0:(genops.c:885:class_export_put()) final put ffff88b64a6cf800/OSS_uuid 00000020:00000080:0.0:1789583819.266104:0:13332:0:(genops.c:844:class_export_destroy()) destroying export ffff88b64a6cf800/OSS_uuid for OSS 00000020:01000000:0.0:1789583819.266110:0:13332:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789583819.266205:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff88b648c8ec00:6704] 1 exiting: rc = 0 00000100:00100000:0.0:1789583819.266289:0:9665:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff88b67b1a7600:9665] 3 exiting: rc = 0 00000100:00100000:2.0:1789583819.267157:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff88b67c540c00:6702] 0 exiting: rc = 1 00000100:00080000:1.0:1789583819.267327:0:5844:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789583819.267714:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff88b67c541c00:6705] 2 exiting: rc = 0 00000100:00100000:1.0:1789583819.267836:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267843:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267851:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267856:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267874:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267879:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267884:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267890:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267895:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267901:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267907:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267911:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267916:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267923:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267927:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267932:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267937:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267942:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267947:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267952:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267967:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267972:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267977:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267982:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267987:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267992:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.267997:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268002:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268006:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268012:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268017:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268022:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268027:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268032:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268037:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268042:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268047:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268052:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268056:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268071:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268080:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268085:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268090:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268095:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268100:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268106:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268111:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268116:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268122:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268130:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268138:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268144:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268150:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268157:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268163:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268169:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268175:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268182:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268191:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268197:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268203:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268209:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268214:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.268219:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583819.269105:0:12442:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff88b6752e4a00:12442] 2 exiting: rc = 0 00000100:00100000:2.0:1789583819.269194:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff88b67c541e00:6707] 1 exiting: rc = 0 00000100:00100000:2.0:1789583819.269244:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff88b67b517c00:6706] 0 exiting: rc = 1 00000100:00100000:1.0:1789583819.269645:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269653:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269658:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269662:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269667:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269672:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269677:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269681:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269686:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269690:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269708:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269714:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269719:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269723:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269729:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269734:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269739:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269744:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269749:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269754:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269759:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269764:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269769:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269774:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269779:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269784:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269789:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269793:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269798:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269802:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269843:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269848:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269853:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269858:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269863:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269868:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269873:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269879:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269884:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269889:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269894:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269898:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269903:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269909:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269915:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269927:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269932:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269938:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269944:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269950:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269967:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269974:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269982:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269986:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269994:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.269999:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270004:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270009:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270014:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270019:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270024:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270029:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270035:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.270040:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583819.271586:0:6710:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff88b67b517400:6710] 2 exiting: rc = 0 00000100:00100000:0.0:1789583819.271998:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff88b67b517a00:6709] 1 exiting: rc = 0 00000100:00100000:3.0:1789583819.272240:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff88b67b517800:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1789583819.272359:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272368:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272374:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272380:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272387:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272393:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272399:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272405:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272410:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272416:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272422:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272428:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272434:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272440:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272446:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272452:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272466:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272472:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272477:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272482:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272487:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272492:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272497:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272503:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272524:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272532:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272537:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272543:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272616:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272625:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272630:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272636:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272641:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272647:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272653:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272658:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272664:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272669:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272675:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272680:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272686:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272692:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272697:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272702:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272707:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272711:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272716:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272721:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272741:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272748:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272754:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272766:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272771:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272777:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272783:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272788:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272794:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.272800:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.273269:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.273278:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.273283:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.273288:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.273293:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.273299:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789583819.283590:0:6712:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff88b67b516200:6712] 1 exiting: rc = 0 00000100:00100000:3.0:1789583819.283680:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff88b67b517600:6711] 0 exiting: rc = 1 00000100:00100000:1.0:1789583819.283713:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.283720:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.283724:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.283729:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.283734:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.283739:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284273:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284280:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284300:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284308:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284313:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284318:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284324:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284329:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284334:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284339:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284345:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284350:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284356:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284361:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284367:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284373:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284390:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284396:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284403:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284408:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284414:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284420:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284426:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284431:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284437:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284443:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284456:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284461:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284467:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284472:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284477:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284481:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284487:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284493:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284499:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284504:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284509:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284515:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284521:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284525:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284530:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284535:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284541:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284547:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284552:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284558:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284563:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284568:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284584:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284591:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284600:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284614:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284620:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284626:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284633:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284638:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284644:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.284649:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789583819.289019:0:6713:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff88b66de45e00:6713] 0 exiting: rc = 1 00000100:00100000:0.0:1789583819.289538:0:6714:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff88b66de45800:6714] 1 exiting: rc = 0 00000100:00100000:1.0:1789583819.291456:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291465:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291472:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291479:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291486:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291510:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291517:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291523:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291529:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291535:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291541:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291547:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291553:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291560:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291567:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291636:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291643:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291663:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291672:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291679:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291686:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291692:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291698:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291705:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291712:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291719:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291727:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291732:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291752:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291774:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291783:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291788:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291794:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291801:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291933:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291940:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291945:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291951:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291967:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291978:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.291985:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292008:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292015:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292021:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292028:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292034:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292039:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292046:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292054:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292062:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292098:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292105:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292110:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292132:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292140:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292146:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292153:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292159:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292164:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292170:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292176:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292182:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292188:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789583819.292645:0:13332:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789583819.313447:0:13332:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789583836.956870:0:13950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789583844.679555:0:14412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789583844.679570:0:14412:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789583844.679677:0:14412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b674c49000 00000020:01000004:0.0:1789583844.679691:0:14412:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789583844.679699:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789583844.679714:0:14412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff88b67c5b19c0) 00000020:00000080:0.0:1789583844.679739:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789583844.700219:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789583844.701971:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789583844.702914:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 353: rc = 0 00100000:10000000:0.0:1789583844.703086:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789583844.703140:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 353: rc = 0 00100000:10000000:0.0:1789583844.705147:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 353: rc = 0 00100000:10000000:0.0:1789583844.705404:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 353: rc = 0 00100000:10000000:0.0:1789583844.705509:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 353: rc = 0 00100000:10000000:0.0:1789583844.705614:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 353: rc = 0 00100000:10000000:0.0:1789583844.705958:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 355: rc = 0 00100000:10000000:2.0:1789583844.713644:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 626: rc = 0 00100000:10000000:2.0:1789583844.713751:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 626: rc = 0 00100000:10000000:2.0:1789583844.715517:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 89: rc = 0 00100000:10000000:2.0:1789583844.715759:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 89: rc = 0 00100000:10000000:2.0:1789583844.717656:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 89: rc = 0 00100000:10000000:2.0:1789583844.717999:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 89: rc = 0 00100000:10000000:2.0:1789583844.718243:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 89: rc = 0 00100000:10000000:2.0:1789583844.718480:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 89: rc = 0 00100000:10000000:2.0:1789583844.718715:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 89: rc = 0 00100000:10000000:2.0:1789583844.719709:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 89: rc = 0 00100000:10000000:2.0:1789583844.720058:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 89: rc = 0 00100000:10000000:2.0:1789583844.720316:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 89: rc = 0 00100000:10000000:2.0:1789583844.720554:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 89: rc = 0 00100000:10000000:2.0:1789583844.720854:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 89: rc = 0 00100000:10000000:2.0:1789583844.722411:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:2.0:1789583844.722657:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:2.0:1789583844.722940:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:2.0:1789583844.723188:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:2.0:1789583844.723426:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:2.0:1789583844.723661:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:2.0:1789583844.724499:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:2.0:1789583844.724740:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:2.0:1789583844.725158:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:2.0:1789583844.725406:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:2.0:1789583844.725658:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:2.0:1789583844.727134:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:2.0:1789583844.727390:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:2.0:1789583844.727640:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:2.0:1789583844.728361:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:2.0:1789583844.728607:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:2.0:1789583844.731213:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:2.0:1789583844.731493:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:2.0:1789583844.731753:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:2.0:1789583844.733493:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:2.0:1789583844.734178:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:2.0:1789583844.734426:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:2.0:1789583844.734676:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:2.0:1789583844.735244:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:2.0:1789583844.735485:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:2.0:1789583844.735901:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:2.0:1789583844.736229:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:2.0:1789583844.736479:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:2.0:1789583844.740209:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:2.0:1789583844.740546:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:2.0:1789583844.741683:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:2.0:1789583844.742155:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:2.0:1789583844.742588:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 631: rc = 0 00100000:10000000:2.0:1789583844.744942:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789583844.745594:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 627: rc = 0 00100000:10000000:2.0:1789583844.747181:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789583844.747319:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 627: rc = 0 00100000:10000000:2.0:1789583844.747538:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789583844.747604:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 627: rc = 0 00100000:10000000:2.0:1789583844.749606:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789583844.749693:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 411: rc = 0 00100000:10000000:2.0:1789583844.751946:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789583844.752114:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 411: rc = 0 00100000:10000000:2.0:1789583844.753297:0:14412:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789583844.753387:0:14412:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 411: rc = 0 00000020:00000080:2.0:1789583844.753706:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789583844.753714:0:14412:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789583844.753724:0:14412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3e09 00000020:01000004:2.0:1789583844.753731:0:14412:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789583844.753736:0:14412:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789583844.753741:0:14412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b674c49000 from MGS 00000020:01000004:2.0:1789583844.753745:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789583844.753754:0:14412:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff88b67c4b8000) 00000020:00000080:2.0:1789583844.753774:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789583844.756151:0:14412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b674c49000 from MGS, refs=2 00080000:01000000:2.0:1789583844.756164:0:14412:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789583844.756177:0:14412:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3e17 00000100:00100000:2.0:1789583844.756310:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789583844.756445:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789583844.756451:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789583844.758255:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789583844.758265:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789583844.758950:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789583844.759230:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789583844.759237:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789583844.760205:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789583844.760213:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789583844.760606:0:14412:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789583844.760612:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789583844.761881:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583844.761885:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583844.761887:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583844.762404:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583844.762407:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583844.762409:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583844.763089:0:14412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789583844.767671:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789583844.781692:0:14412:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789583844.781708:0:14412:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789583844.781717:0:14412:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789583844.786400:0:14421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789583844.786637:0:14412:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789583844.786750:0:14412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789583844.787410:0:14412:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789583844.787707:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789583844.789781:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789583844.789791:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789583844.790500:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789583844.790507:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789583844.795255:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789583844.795267:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1789583844.796017:0:14426:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1789583844.796210:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789583844.796231:0:14412:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.146@tcp' 00000020:01000004:0.0:1789583844.796232:0:14412:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789583844.796261:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.146@tcp (typ=mgc) 00000020:00000080:0.0:1789583844.796273:0:14412:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.146@tcp (ffff88b67c5b4d40) 00000020:00000080:0.0:1789583844.796288:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789583844.796358:0:14412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b67b6c8800@MGC192.168.203.146@tcp: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789583844.796505:0:14412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.146@tcp-0 is initialized 00000040:01000000:0.0:1789583844.796511:0:14412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789583844.809225:0:14427:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789583844.809314:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.146@tcp (uuid bec31d4c-70f2-4e81-b20d-79c0fd90522d) 00000020:00000080:3.0:1789583844.809338:0:14412:0:(genops.c:1384:class_connect()) connect: client bec31d4c-70f2-4e81-b20d-79c0fd90522d, cookie 0x6d3e73d72c6e3e25 00000100:00080000:3.0:1789583844.809351:0:14412:0:(import.c:545:import_select_connection()) MGC192.168.203.146@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789583844.809362:0:14412:0:(import.c:666:import_select_connection()) MGC192.168.203.146@tcp: import ffff88b67b6c8800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789583844.809396:0:14412:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763e8000 x1876514332295424/t0(0) o250->MGC192.168.203.146@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789583844.809427:0:14412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import bec31d4c-70f2-4e81-b20d-79c0fd90522d->MGS 00000020:01000004:3.0:1789583844.809448:0:14412:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789583844.809453:0:14412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789583844.809467:0:14412:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff88b6622999c0) 00000020:00000080:3.0:1789583844.809478:0:14412:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789583844.809929:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3304:1876514332295424:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789583844.810064:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.810452:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332295424 00000100:00100000:0.0:1789583844.810461:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332295424 00000100:00100000:0.0:1789583844.811087:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583844.811096:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3304:x1876514332295424:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789583844.811121:0:14423:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bec31d4c-70f2-4e81-b20d-79c0fd90522d@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:0.0:1789583844.811144:0:14423:0:(genops.c:1384:class_connect()) connect: client bec31d4c-70f2-4e81-b20d-79c0fd90522d, cookie 0x6d3e73d72c6e3e33 00000100:00080000:0.0:1789583844.811266:0:14423:0:(import.c:65:import_set_state_nolock()) ffff88b67b6c9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583844.811342:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+5:3304:x1876514332295424:12345-0@lo:250:mount.lustre.0 Request processed in 246us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583844.811350:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583844.811453:0:3304:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.146@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789583844.811462:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.146@tcp: connect to target with instance 0 00000100:00080000:1.0:1789583844.811469:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.146@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789583844.811473:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789583844.811476:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b67b6c8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789583844.811479:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789583844.811487:0:3304:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789583844.811492:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3304:1876514332295424:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789583844.824916:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789583844.825106:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789583844.825112:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789583844.832462:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789583844.832474:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789583844.833634:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789583844.833642:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789583844.834559:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583844.834739:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789583844.834745:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789583844.840133:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789583844.840145:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789583844.894192:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789583844.894404:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789583844.894411:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789583844.897247:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789583844.897262:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789583844.898901:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583844.899106:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789583844.899113:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789583844.900595:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789583844.900604:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789583844.904930:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789583844.905125:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789583844.905131:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789583844.906111:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789583844.906120:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789583844.906917:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583844.907193:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789583844.907198:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789583844.907774:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789583844.907781:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789583844.922961:0:14412:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789583844.923188:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789583844.923196:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789583844.924350:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789583844.924364:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789583844.925288:0:14412:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789583844.925297:0:14412:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789583844.926243:0:14412:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789583844.926268:0:14412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789583844.926275:0:14412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789583844.926405:0:14412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789583844.926441:0:14412:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789583844.926446:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789583844.926448:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583844.926450:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583844.926451:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583844.926452:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583844.926454:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583844.926455:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583844.926457:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583844.926458:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583844.926459:0:14412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583844.926462:0:14412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789583844.926464:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789583844.926465:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583844.926466:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583844.926467:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583844.926468:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583844.926470:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583844.926471:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583844.926472:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583844.926473:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583844.926474:0:14412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583844.926501:0:14412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789583844.926520:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295552:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789583844.926592:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.926701:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6439f4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583844.926750:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332295552 00000100:00100000:3.0:1789583844.926760:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332295552 00000100:00100000:3.0:1789583844.926938:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583844.926948:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+5:14412:x1876514332295552:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789583844.927000:0:14425:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789583844.927003:0:14425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789583844.927006:0:14425:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1789583844.927304:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789583844.927650:0:14425:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789583844.928656:0:14447:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789583844.928660:0:14447:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789583844.928662:0:14447:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789583844.928681:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789583844.929052:0:14425:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789583844.929060:0:14425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789583844.933437:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+5:14412:x1876514332295552:12345-0@lo:253:mount.lustre.0 Request processed in 6483us (6837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583844.933455:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583844.933577:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295552:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789583844.933594:0:14412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789583844.933597:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789583844.933599:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789583844.933614:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583844.933615:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583844.933617:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583844.933618:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583844.933619:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789583844.933621:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789583844.933623:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583844.933624:0:14412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789583844.933643:0:14412:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b674c49000 from lustre-MDT0000 10000000:01000000:0.0:1789583844.933668:0:14412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789583844.933671:0:14412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789583844.933674:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff88b67c5b4d40 10000000:01000000:0.0:1789583844.933679:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789583844.933687:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff88b67c5b4d40 from 1 10000000:01000000:0.0:1789583844.933690:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789583844.933731:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.933742:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.933752:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583844.933784:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789583844.933889:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.933971:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583844.934094:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332295680 00000100:00100000:2.0:1789583844.934102:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332295680 00000100:00100000:2.0:1789583844.934145:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789583844.934154:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+5:14412:x1876514332295680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789583844.934165:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583844.934180:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1600/0x6d3e73d72c6e3e41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3e3a expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583844.934202:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1600/0x6d3e73d72c6e3e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3e3a expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583844.934212:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1600/0x6d3e73d72c6e3e41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3e3a expref: 6 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583844.934219:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1600, rc 0) 00000100:00100000:2.0:1789583844.934569:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+6:14412:x1876514332295680:12345-0@lo:101:mount.lustre.0 Request processed in 408us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583844.934577:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583844.936241:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583844.936267:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.936279:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583844.936363:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583844.936410:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.936453:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583844.936959:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332295808 00000100:00100000:3.0:1789583844.936967:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332295808 00000100:00100000:3.0:1789583844.937133:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583844.937143:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+6:14412:x1876514332295808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583844.937490:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+6:14412:x1876514332295808:12345-0@lo:501:mount.lustre.0 Request processed in 347us (1078us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789583844.937508:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789583844.937617:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295808:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789583844.937646:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789583844.937666:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.937678:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583844.937687:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b674c49000 10000000:01000000:0.0:1789583844.937692:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789583844.937696:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88b674c49000 10000000:01000000:0.0:1789583844.937699:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789583844.937702:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88b674c49000 from 1 10000000:01000000:0.0:1789583844.937704:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789583844.937730:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.937738:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.937747:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583844.937773:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295936:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789583844.937844:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.937874:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583844.938803:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332295936 00000100:00100000:3.0:1789583844.938840:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332295936 00000100:00100000:3.0:1789583844.938876:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583844.938885:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+6:14412:x1876514332295936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583844.938896:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583844.938913:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641483400/0x6d3e73d72c6e3e4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3e48 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583844.938937:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641483400/0x6d3e73d72c6e3e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3e48 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583844.938948:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641483400/0x6d3e73d72c6e3e4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3e48 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583844.938966:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483400, rc 0) 00000100:00100000:3.0:1789583844.939927:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+7:14412:x1876514332295936:12345-0@lo:101:mount.lustre.0 Request processed in 1040us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583844.939936:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583844.940557:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332295936:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583844.940589:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e4f expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.940600:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3e4f expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583844.940618:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789583844.940634:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e4f expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.940643:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df55200/0x6d3e73d72c6e3e48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e4f expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583844.940652:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789583844.940657:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789583844.940663:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88b674c49000 10000000:01000000:0.0:1789583844.940665:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789583844.940669:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789583844.940672:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789583844.940695:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.940703:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.940714:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583844.940740:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332296064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789583844.940787:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.940842:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583844.941045:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332296064 00000100:00100000:3.0:1789583844.941051:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332296064 00000100:00100000:3.0:1789583844.941091:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789583844.941099:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+7:14412:x1876514332296064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583844.941108:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583844.941119:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641482a00/0x6d3e73d72c6e3e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3e56 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583844.941135:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641482a00/0x6d3e73d72c6e3e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3e56 expref: 8 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583844.941144:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641482a00/0x6d3e73d72c6e3e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3e56 expref: 8 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583844.941151:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482a00, rc 0) 00000100:00100000:3.0:1789583844.941199:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+8:14412:x1876514332296064:12345-0@lo:101:mount.lustre.0 Request processed in 100us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583844.941205:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789583844.941340:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332296064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583844.941351:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e5d expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583844.941360:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3e5d expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583844.941403:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332296192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583844.941428:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.941449:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583844.941674:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332296192 00000100:00100000:3.0:1789583844.941678:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332296192 00000100:00100000:3.0:1789583844.941706:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583844.941712:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+8:14412:x1876514332296192:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583844.942238:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14412:x1876514332296192:12345-0@lo:501:mount.lustre.0 Request processed in 524us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583844.942251:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789583844.942314:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332296192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583844.942342:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332296320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789583844.942376:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.942407:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c15b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583844.942448:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332296320 00000100:00100000:2.0:1789583844.942452:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332296320 00000100:00100000:2.0:1789583844.942490:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583844.942497:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14412:x1876514332296320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789583844.942778:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14412:x1876514332296320:12345-0@lo:503:mount.lustre.0 Request processed in 281us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583844.942785:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789583844.942968:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332296320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789583844.943316:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14448:1876514332296448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583844.943351:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583844.943390:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf180 going to sleep for 11 seconds 00000100:00100000:3.0:1789583844.943434:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332296448 00000100:00100000:3.0:1789583844.943439:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332296448 00000100:00100000:3.0:1789583844.943463:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789583844.943470:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14448:x1876514332296448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583844.943803:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14448:x1876514332296448:12345-0@lo:502:llog_process_th.0 Request processed in 333us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583844.943828:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789583844.943944:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14448:1876514332296448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789583844.944032:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583844.944048:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583844.944051:0:14448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789583844.944056:0:14448:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789583844.944059:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789583844.944073:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff88b67c5b0000) 00000020:00000080:0.0:1789583844.944089:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789583844.944093:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789583844.944164:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789583844.944171:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3e6b 00000020:00000080:0.0:1789583844.944418:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789583844.944422:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583844.944426:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583844.944428:0:14448:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789583844.944431:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583844.944434:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583844.944436:0:14448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789583844.944439:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789583844.944446:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff88b67c5b3380) 00000020:00000080:0.0:1789583844.944456:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789583844.944459:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789583844.944461:0:14448:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789583844.944463:0:14448:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789583844.944469:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789583844.944604:0:14448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b674c49000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789583844.944624:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff88b66de299c0) 00000020:00000080:0.0:1789583844.944633:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789583844.944677:0:14448:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789583844.944683:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e3e80 00000020:00000080:0.0:1789583844.944799:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789583844.944823:0:14448:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789583844.944835:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6d3e73d72c6e3e87 00080000:01000000:0.0:1789583844.944840:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789583844.944844:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3e8e 00010000:00010000:1.0:1789583845.005448:0:14448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789583845.006599:0:14448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1789583845.006845:0:14448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789583845.007628:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff88b67c4bb380) 00000020:00000080:2.0:1789583845.007647:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789583845.007728:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789583845.007735:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3e9c 00000020:00000080:1.0:1789583845.010592:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789583845.021928:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6d3e73d72c6e3ea3 00000020:00000080:3.0:1789583845.023238:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789583845.023250:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583845.023257:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.023259:0:14448:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789583845.023262:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789583845.023264:0:14448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789583845.023266:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789583845.023268:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789583845.023269:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789583845.023271:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.023272:0:14448:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789583845.023275:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583845.023280:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.023281:0:14448:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789583845.023285:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789583845.023321:0:14448:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789583845.023337:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583845.023340:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.023341:0:14448:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789583845.023344:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789583845.023347:0:14448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789583845.023357:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.023369:0:14448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789583845.023374:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789583845.023379:0:14448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:3.0:1789583845.023404:0:14448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789583845.023407:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789583845.023421:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff88b66229cd40) 00000020:00000080:3.0:1789583845.023436:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789583845.023442:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789583845.023506:0:14448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789583845.023512:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789583845.023518:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3eb1 00010000:00080000:3.0:1789583845.023546:0:14448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b66e246800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789583845.023758:0:14448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789583845.024230:0:14448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789583845.024273:0:14448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789583845.025548:0:14448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583845.025603:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789583845.025666:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789583845.026926:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789583845.026932:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789583845.027665:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789583845.027676:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789583845.027704:0:14448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789583845.027723:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e3eb8 00000100:00080000:3.0:1789583845.027732:0:14448:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789583845.027742:0:14448:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88b66e246800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:3.0:1789583845.027785:0:14448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763e9f80 x1876514332296576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789583845.027866:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332296576:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789583845.027918:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514332296576 offset 0 length 520: 4 00000100:00080000:3.0:1789583845.028001:0:14448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789583845.028059:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583845.028063:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.028065:0:14448:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789583845.028067:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789583845.028070:0:14448:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789583845.028071:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789583845.028073:0:14448:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789583845.028075:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789583845.028077:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.028079:0:14448:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789583845.028081:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789583845.028085:0:14448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789583845.028088:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.028090:0:14448:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789583845.028093:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789583845.028096:0:14448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.146@tcp to nid 0x20000c0a8cb92 (192.168.203.146@tcp) 00000020:01000000:3.0:1789583845.028116:0:14448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789583845.028118:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789583845.028129:0:14448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff88b66229b380) 00000020:00000080:3.0:1789583845.028139:0:14448:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789583845.028144:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789583845.028203:0:14448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789583845.028208:0:14448:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789583845.028214:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d3e73d72c6e3ec6 00010000:00080000:3.0:1789583845.028238:0:14448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b6444c7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:3.0:1789583845.028438:0:14448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789583845.028587:0:14448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789583845.028606:0:14448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789583845.029069:0:14448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583845.029125:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789583845.029184:0:14448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789583845.029474:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789583845.029486:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332296704:0@lo:400:kworker.0 00000100:00100000:2.0:1789583845.029542:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583845.029586:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332296704 00000100:00100000:2.0:1789583845.029592:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332296704 00000100:00100000:2.0:1789583845.029627:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789583845.029635:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:3307:x1876514332296704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583845.029678:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:3307:x1876514332296704:12345-0@lo:400:kworker.0 Request processed in 44us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583845.029684:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789583845.029726:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332296704:0@lo:400:kworker.0 00000040:00080000:2.0:1789583845.030462:0:14454:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789583845.030467:0:14454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789583845.031290:0:14448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789583845.031299:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789583845.031328:0:14448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789583845.031347:0:14448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e3ecd 00000100:00080000:0.0:1789583845.031355:0:14448:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789583845.031432:0:14448:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b6444c7000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789583845.031464:0:14448:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6752a2a00 x1876514332296832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789583845.031519:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332296832:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789583845.031563:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514332296832 offset 0 length 520: 4 00000100:00080000:0.0:1789583845.031616:0:14448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789583845.031674:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583845.031678:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583845.031680:0:14448:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789583845.031683:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583845.031686:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583845.031688:0:14448:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789583845.031691:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789583845.031692:0:14448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789583845.031694:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583845.031696:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583845.031698:0:14448:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789583845.031700:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583845.031702:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583845.031703:0:14448:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789583845.031705:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789583845.031733:0:14448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14448:1876514332296960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583845.031790:0:14448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583845.031855:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332296960 00000100:00100000:0.0:1789583845.031862:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332296960 00000100:00100000:0.0:1789583845.031894:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789583845.031911:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14448:x1876514332296960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583845.032181:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14448:x1876514332296960:12345-0@lo:502:llog_process_th.0 Request processed in 269us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.032188:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789583845.032222:0:14448:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf480 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.032238:0:14448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14448:1876514332296960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789583845.032258:0:14448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583845.032262:0:14448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583845.032263:0:14448:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789583845.032267:0:14448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789583845.032712:0:14412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1789583845.032736:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789583845.032760:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e5d expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.032781:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df54000/0x6d3e73d72c6e3e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e5d expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583845.032789:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b674c49000 from 1 10000000:01000000:3.0:1789583845.032792:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789583845.032843:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.032852:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.032862:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.032877:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789583845.032906:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.032933:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583845.033082:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297088 00000100:00100000:2.0:1789583845.033088:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297088 00000100:00100000:2.0:1789583845.033120:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789583845.033135:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+9:14412:x1876514332297088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789583845.033145:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583845.033158:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3ed4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.033181:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.033192:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.033202:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1c00, rc 0) 00000100:00100000:2.0:1789583845.033243:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+10:14412:x1876514332297088:12345-0@lo:101:mount.lustre.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583845.033250:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789583845.033433:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583845.033447:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.033456:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.034223:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297216:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789583845.034325:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.034449:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.034483:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297216 00000100:00100000:0.0:1789583845.034490:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297216 00000100:00100000:0.0:1789583845.034553:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583845.034562:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+10:14412:x1876514332297216:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789583845.034577:0:14425:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789583845.034583:0:14425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789583845.034653:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+10:14412:x1876514332297216:12345-0@lo:256:mount.lustre.0 Request processed in 92us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.034659:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789583845.034712:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297216:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789583845.035290:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789583845.035310:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.035320:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583845.035329:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b674c49000 from 1 10000000:01000000:3.0:1789583845.035331:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789583845.035357:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.035376:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.035385:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.035401:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789583845.035430:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.035760:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583845.035888:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297344 00000100:00100000:2.0:1789583845.035894:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297344 00000100:00100000:2.0:1789583845.035922:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789583845.035930:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+10:14412:x1876514332297344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789583845.035941:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583845.035954:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3ee2 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.035976:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.035999:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.036023:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0800, rc 0) 00000100:00100000:2.0:1789583845.036063:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332297344:12345-0@lo:101:mount.lustre.0 Request processed in 134us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583845.036070:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789583845.036213:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583845.036227:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.036247:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.036303:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583845.036331:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.036372:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.036469:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297472 00000100:00100000:0.0:1789583845.036474:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297472 00000100:00100000:0.0:1789583845.036497:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789583845.036505:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332297472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583845.036914:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332297472:12345-0@lo:501:mount.lustre.0 Request processed in 409us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.036921:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789583845.037014:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583845.037045:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789583845.037093:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.037113:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.037385:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297600 00000100:00100000:0.0:1789583845.037395:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297600 00000100:00100000:0.0:1789583845.037417:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789583845.037424:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332297600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789583845.037572:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332297600:12345-0@lo:503:mount.lustre.0 Request processed in 149us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.037579:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789583845.037797:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789583845.038238:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14456:1876514332297728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583845.038277:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583845.038312:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6623b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.038348:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297728 00000100:00100000:0.0:1789583845.038353:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297728 00000100:00100000:0.0:1789583845.038447:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583845.038455:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14456:x1876514332297728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583845.038642:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14456:x1876514332297728:12345-0@lo:502:llog_process_th.0 Request processed in 188us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.038649:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789583845.038748:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14456:1876514332297728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789583845.038783:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583845.038792:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.038795:0:14456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789583845.038803:0:14456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b674c49000 00000020:00000080:3.0:1789583845.038863:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789583845.038873:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583845.038877:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.038878:0:14456:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789583845.038881:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583845.038884:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.038885:0:14456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789583845.038889:0:14456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b674c49000 00000020:00000080:3.0:1789583845.038891:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789583845.038951:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583845.038960:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.038962:0:14456:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789583845.038965:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583845.038969:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.038970:0:14456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789583845.038974:0:14456:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88b674c49000 00000020:00000080:3.0:1789583845.038975:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789583845.039083:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14456:1876514332297856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583845.039118:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.039138:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583845.039193:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297856 00000100:00100000:2.0:1789583845.039198:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297856 00000100:00100000:2.0:1789583845.039229:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789583845.039236:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14456:x1876514332297856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583845.039438:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14456:x1876514332297856:12345-0@lo:502:llog_process_th.0 Request processed in 201us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583845.039445:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789583845.040497:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14456:1876514332297856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789583845.040528:0:14456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583845.040535:0:14456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583845.040537:0:14456:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789583845.040541:0:14456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789583845.040599:0:14412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789583845.040621:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583845.040643:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.040654:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583845.040698:0:14412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789583845.040701:0:14412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b674c49000 10000000:01000000:3.0:1789583845.040704:0:14412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b674c49000 10000000:01000000:3.0:1789583845.040709:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789583845.040714:0:14412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b674c49000 from 1 10000000:01000000:3.0:1789583845.040717:0:14412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789583845.040742:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.040756:0:14412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.040777:0:14412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.040796:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789583845.040854:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.040884:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583845.041651:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332297984 00000100:00100000:2.0:1789583845.041661:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332297984 00000100:00100000:2.0:1789583845.041701:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789583845.041710:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332297984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789583845.041721:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583845.041734:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3ef0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.041758:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ef0 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.041780:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a0600/0x6d3e73d72c6e3ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ef0 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583845.041797:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0600, rc 0) 00000100:00100000:2.0:1789583845.041867:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14412:x1876514332297984:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583845.041874:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789583845.041973:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332297984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583845.042436:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3ef7 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583845.042448:0:14412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3ef7 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.042510:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332298112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583845.042542:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.042580:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583845.042701:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298112 00000100:00100000:1.0:1789583845.042707:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298112 00000100:00100000:1.0:1789583845.042752:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789583845.042760:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14412:x1876514332298112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789583845.044482:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14412:x1876514332298112:12345-0@lo:501:mount.lustre.0 Request processed in 1717us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583845.044500:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789583845.045198:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332298112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583845.045353:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332298240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789583845.045421:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.045457:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a329cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583845.045705:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298240 00000100:00100000:1.0:1789583845.045711:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298240 00000100:00100000:1.0:1789583845.045758:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789583845.045777:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14412:x1876514332298240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789583845.045960:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14412:x1876514332298240:12345-0@lo:503:mount.lustre.0 Request processed in 184us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583845.045967:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789583845.047167:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332298240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789583845.065037:0:14459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14459:1876514332298368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789583845.065115:0:14459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583845.065163:0:14459:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.065213:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298368 00000100:00100000:0.0:1789583845.065220:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298368 00000100:00100000:0.0:1789583845.065267:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789583845.065276:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14459:x1876514332298368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789583845.065503:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14459:x1876514332298368:12345-0@lo:502:llog_process_th.0 Request processed in 227us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.065512:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789583845.065732:0:14459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14459:1876514332298368:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789583845.065802:0:14459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789583845.065913:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff88b67c4b99c0) 00000020:00000080:2.0:1789583845.065931:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789583845.066003:0:14459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b674c49000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789583845.066007:0:14459:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b674c49000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789583845.066010:0:14459:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b674c49000 4 00010000:00080000:2.0:1789583845.066037:0:14459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b666647000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789583845.067707:0:14459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789583845.067924:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789583845.067953:0:14459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789583845.067964:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6d3e73d72c6e3f05 00000100:00080000:2.0:1789583845.067972:0:14459:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789583845.067981:0:14459:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88b666647000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583845.068011:0:14459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763cbb80 x1876514332298496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789583845.068031:0:14459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789583845.068850:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332298496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789583845.068910:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.069067:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298496 00000100:00100000:3.0:1789583845.069079:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298496 00000100:00100000:3.0:1789583845.069117:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789583845.069125:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876514332298496:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789583845.069182:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876514332298496:12345-0@lo:38:llog_process_th.0 Request processed in 56us (271us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789583845.069190:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789583845.069241:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789583845.069249:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b666647000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789583845.069253:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789583845.069257:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332298496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789583845.071914:0:14459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14459:1876514332298624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789583845.071983:0:14459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583845.072026:0:14459:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813a60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583845.072124:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298624 00000100:00100000:1.0:1789583845.072131:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298624 00000100:00100000:1.0:1789583845.072169:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789583845.072178:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14459:x1876514332298624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789583845.072415:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14459:x1876514332298624:12345-0@lo:502:llog_process_th.0 Request processed in 238us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583845.072423:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789583845.074019:0:14459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14459:1876514332298624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789583845.074051:0:14459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789583845.074162:0:14412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789583845.074185:0:14412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789583845.074205:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3ef7 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583845.074216:0:14412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641482e00/0x6d3e73d72c6e3ef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3ef7 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789583845.074261:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789583845.074267:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789583845.074269:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583845.074270:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583845.074271:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583845.074273:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583845.074274:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789583845.074275:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789583845.074277:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583845.074278:0:14412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583845.074281:0:14412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789583845.074284:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789583845.074285:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789583845.074286:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583845.074287:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583845.074288:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583845.074289:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583845.074290:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789583845.074291:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789583845.074292:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583845.074293:0:14412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583845.074311:0:14412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789583845.074323:0:14412:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332298752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789583845.074368:0:14412:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583845.074395:0:14412:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66ed390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583845.074727:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298752 00000100:00100000:2.0:1789583845.074739:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298752 00000100:00100000:2.0:1789583845.074785:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789583845.074795:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14412:x1876514332298752:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789583845.074843:0:14425:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789583845.074855:0:14425:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789583845.117346:0:14425:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789583845.117460:0:14425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789583845.121684:0:14446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789583845.121692:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789583845.121718:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.121753:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.121772:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.121835:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.121850:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 12 pid: 14424 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583845.121864:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1876514332298880:0@lo:104: 00000100:00100000:0.0:1789583845.121929:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583845.121972:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813a60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583845.122007:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332298880 00000100:00100000:0.0:1789583845.122014:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332298880 00000100:00100000:0.0:1789583845.122058:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583845.122066:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14446:x1876514332298880:12345-0@lo:104: 00010000:00010000:0.0:1789583845.122079:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122128:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789583845.122134:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14446:x1876514332298880:12345-0@lo:104: Request processed in 70us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.122140:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789583845.122162:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583845.122168:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122181:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:0.0:1789583845.122185:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122192:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789583845.122198:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583845.122203:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789583845.122227:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122233:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789583845.122248:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122254:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e3ed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3edb expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122270:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583845.122272:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583845.122273:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583845.122299:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3305:1876514332299008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583845.122324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583845.122384:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299008 00000100:00100000:0.0:1789583845.122389:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299008 00010000:00010000:0.0:1789583845.122405:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 13 pid: 14424 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583845.122435:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583845.122442:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+13:3305:x1876514332299008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583845.122453:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583845.122458:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 13 pid: 14424 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122469:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 13 pid: 14424 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122484:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122492:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789583845.122515:0:14415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000823766s 00010000:00010000:0.0:1789583845.122519:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122527:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122534:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122540:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122546:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55800 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583845.122555:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122562:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122571:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.122581:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583845.122606:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+13:3305:x1876514332299008:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583845.122613:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583845.122942:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3305:1876514332299008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583845.122976:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3edb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ed4 expref: 12 pid: 14424 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583845.122987:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1876514332298880:0@lo:104: 00010000:00010000:0.0:1789583845.122999:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.123008:0:14446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.123015:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583845.123021:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e3f0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583845.124994:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14412:x1876514332298752:12345-0@lo:253:mount.lustre.0 Request processed in 50195us (50619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583845.125007:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789583845.125076:0:14412:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14412:1876514332298752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789583845.125091:0:14412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789583845.125150:0:14412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789583845.125152:0:14412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789583845.125154:0:14412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583845.125155:0:14412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583845.125156:0:14412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583845.125158:0:14412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583845.125159:0:14412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789583845.125160:0:14412:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789583845.125162:0:14412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583845.125163:0:14412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789583845.125176:0:14412:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789583845.130590:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583845.130756:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583845.131075:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583845.131234:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583845.131976:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583845.132156:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583845.133304:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583845.133726:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583845.134078:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583845.134304:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583845.135618:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583845.135782:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789583845.158610:0:14412:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789583845.158985:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789583845.159428:0:14468:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789583845.159499:0:14468:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583845.161543:0:14468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789583845.161631:0:14468:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789583845.161635:0:14468:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789583845.163522:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789583845.163646:0:14412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789583845.164148:0:14412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789583845.164156:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789583845.164274:0:14412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789583845.165337:0:14467:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789583845.165344:0:14467:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1789583845.165758:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789583845.166427:0:14412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789583845.166459:0:14412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789583845.167989:0:14412:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789583845.172065:0:14412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789583845.191703:0:14412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789583845.191744:0:14412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab7801c9b988 00100000:10000000:1.0:1789583845.191753:0:14412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789583845.192571:0:14412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789583845.192587:0:14412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789583845.192601:0:14412:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789583845.192623:0:14412:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789583845.799364:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789583846.119947:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789583846.248848:0:14427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789583846.248856:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b674c49000 from 6 10000000:01000000:1.0:1789583846.248861:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789583846.248903:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583846.248915:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583846.248926:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583846.248949:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332299136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789583846.249013:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583846.249062:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661d02a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583846.249334:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299136 00000100:00100000:3.0:1789583846.249342:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299136 00000100:00100000:3.0:1789583846.249392:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789583846.249400:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14427:x1876514332299136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583846.249413:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583846.249425:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3f13 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583846.249446:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583846.249456:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583846.249465:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641482200, rc 0) 00000100:00100000:3.0:1789583846.249505:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332299136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583846.249512:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789583846.249729:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332299136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583846.249742:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583846.249750:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583846.249844:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332299264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789583846.249873:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583846.249896:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661d02a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789583846.249991:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299264 00000100:00100000:3.0:1789583846.249995:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299264 00000100:00100000:3.0:1789583846.250022:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789583846.250028:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332299264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789583846.250041:0:14425:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789583846.250055:0:14425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789583846.250058:0:14425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789583846.250119:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332299264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583846.250125:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789583846.250226:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332299264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789583846.250264:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789583846.250270:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583846.250279:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583846.831236:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789583847.143419:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789583847.848227:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583848.886510:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789583849.442211:0:14711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789583849.894962:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789583850.536027:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789583850.536172:0:13980:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789583850.536175:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789583850.536178:0:13980:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789583850.536188:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789583850.536192:0:13980:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789583850.536195:0:13980:0:(import.c:65:import_set_state_nolock()) ffff88b666647000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789583850.536212:0:13980:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88b666647000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789583850.536424:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332299392:0@lo:400:kworker.0 00000100:00100000:0.0:1789583850.536493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583850.536562:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299392 00000100:00100000:0.0:1789583850.536569:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299392 00000100:00100000:0.0:1789583850.536611:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583850.536620:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:3306:x1876514332299392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583850.536669:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:3306:x1876514332299392:12345-0@lo:400:kworker.0 Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583850.536677:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583850.536732:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332299392:0@lo:400:kworker.0 00000100:00100000:1.0:1789583850.536792:0:13980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67c5f0e00 x1876514332299520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789583850.538314:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332299520:0@lo:38:kworker.0 00000100:00100000:0.0:1789583850.538504:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583850.538615:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299520 00000100:00100000:2.0:1789583850.538624:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299520 00000100:00100000:2.0:1789583850.538662:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583850.538669:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1876514332299520:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789583850.538692:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:2.0:1789583850.538734:0:14432:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6d3e73d72c6e3f21 00000004:00100000:2.0:1789583850.538748:0:14432:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789583850.538908:0:14432:0:(import.c:65:import_set_state_nolock()) ffff88b645675000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789583850.538956:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876514332299520:12345-0@lo:38:kworker.0 Request processed in 287us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583850.538964:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789583850.540382:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b67c5f0e00 x1876514332299520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789583860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789583850.540404:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789583850.540413:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789583850.540418:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789583850.540421:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b666647000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789583850.540427:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876514332299520:0@lo:38:kworker.0 00010000:00010000:0.0:1789583850.920116:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583851.946606:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789583852.531977:0:14862:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf226bfe0 20000000:00000080:2.0:1789583852.531994:0:14862:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b67bd79c00 uarg=0000000000000000 20000000:01000000:2.0:1789583852.532028:0:14862:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789583852.532035:0:14862:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789583852.532046:0:14862:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789583852.545699:0:14863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789583852.546004:0:14862:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789583852.559882:0:14862:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789583852.560441:0:14862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583852.560463:0:14862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583852.560471:0:14862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583852.560519:0:14862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583852.560534:0:14862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 11 pid: 14424 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583852.560548:0:14862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14862:1876514332299648:0@lo:104: 00000100:00100000:2.0:1789583852.560612:0:14862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583852.560675:0:14862:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583852.560761:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299648 00000100:00100000:0.0:1789583852.560769:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299648 00000100:00100000:0.0:1789583852.560837:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583852.560848:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14862:x1876514332299648:12345-0@lo:104: 00010000:00010000:0.0:1789583852.560860:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.560932:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789583852.560938:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14862:x1876514332299648:12345-0@lo:104: Request processed in 94us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583852.560945:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789583852.561023:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583852.561031:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583852.561039:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483a00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583852.561043:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583852.561053:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583852.561059:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583852.561065:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789583852.561110:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583852.561117:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583852.561137:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583852.561161:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e3ee2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3ee9 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583852.561179:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583852.561181:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583852.561183:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583852.561215:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332299776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583852.561244:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583852.561598:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299776 00000100:00100000:0.0:1789583852.561604:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299776 00010000:00010000:0.0:1789583852.561624:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 12 pid: 14424 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583852.561654:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583852.561661:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:3307:x1876514332299776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789583852.561670:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583852.561676:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 12 pid: 14424 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561686:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 12 pid: 14424 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561701:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561719:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561743:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561750:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561757:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561763:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561769:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583852.561773:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561781:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561788:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583852.561798:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789583852.561856:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:3307:x1876514332299776:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583852.561863:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583852.561897:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332299776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789583852.564646:0:14862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a0800/0x6d3e73d72c6e3ee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e3ee2 expref: 11 pid: 14424 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583852.564667:0:14862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14862:1876514332299648:0@lo:104: 00010000:00010000:3.0:1789583852.564693:0:14862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583852.564702:0:14862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583852.564718:0:14862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583852.564724:0:14862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1e00/0x6d3e73d72c6e3f28 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583852.969674:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583853.991241:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789583854.311520:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789583854.311527:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b674c49000 from 10 10000000:01000000:1.0:1789583854.311533:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789583854.311580:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583854.311593:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583854.311606:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583854.311630:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332299904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789583854.311706:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583854.311891:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789583854.312722:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332299904 00000100:00100000:2.0:1789583854.312731:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332299904 00000100:00100000:2.0:1789583854.312924:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789583854.312936:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+11:14427:x1876514332299904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583854.312951:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583854.312968:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3f2f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583854.312993:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583854.313022:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583854.313030:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1c00, rc 0) 00000100:00100000:2.0:1789583854.313104:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332299904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583854.313111:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789583854.313207:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332299904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583854.313224:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583854.313233:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583854.313314:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332300032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583854.313343:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583854.313656:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789583854.313771:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332300032 00000100:00100000:0.0:1789583854.313776:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332300032 00000100:00100000:0.0:1789583854.313826:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789583854.313834:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332300032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583854.314128:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332300032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583854.314136:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789583854.314443:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332300032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789583854.314476:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332300160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583854.314518:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583854.314552:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789583854.316239:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332300160 00000100:00100000:0.0:1789583854.316252:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332300160 00000100:00100000:0.0:1789583854.316304:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789583854.316313:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332300160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583854.316524:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:14427:x1876514332300160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583854.316531:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789583854.316703:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332300160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789583854.320452:0:14923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789583854.321170:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789583854.321189:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789583854.321199:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583854.321212:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583855.016306:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583855.654982:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583845/real 1789583845] req@ffff88b6752a2a00 x1876514332296832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583855 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583855.655025:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b6752a2a00 x1876514332296832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583855 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583855.655036:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583845/real 1789583845] req@ffff88b6763e9f80 x1876514332296576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583855 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583855.655066:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b6763e9f80 x1876514332296576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583855 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789583855.655085:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789583855.655114:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789583855.655120:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332296832:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789583855.655127:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b66e246800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789583855.655133:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789583855.655136:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332296576:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789583855.657080:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789583855.657087:0:13980:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789583855.657090:0:13980:0:(import.c:65:import_set_state_nolock()) ffff88b66e246800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789583855.657097:0:13980:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1789583855.657103:0:13980:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789583855.657114:0:13980:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88b66e246800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789583855.657139:0:13980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67c5f3b80 x1876514332300416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789583855.657139:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332300288:0@lo:400:kworker.0 00000100:00080000:1.0:1789583855.657163:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789583855.657168:0:13980:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789583855.657170:0:13980:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789583855.657175:0:13980:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1789583855.657177:0:13980:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789583855.657193:0:13980:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b6444c7000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789583855.657211:0:13980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67c5f3480 x1876514332300544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789583855.657223:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583855.657268:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332300672:0@lo:400:kworker.0 00000100:00100000:0.0:1789583855.657304:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332300288 00000100:00100000:1.0:1789583855.657310:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583855.657312:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332300288 00000100:00100000:0.0:1789583855.657357:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789583855.657369:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:3308:x1876514332300288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583855.657381:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332300672 00000100:00100000:1.0:1789583855.657386:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332300672 00000100:00100000:1.0:1789583855.657424:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583855.657430:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:3308:x1876514332300288:12345-0@lo:400:kworker.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583855.657437:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332300672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583855.657442:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789583855.657493:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332300672:12345-0@lo:400:kworker.0 Request processed in 59us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583855.657502:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789583855.657502:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332300288:0@lo:400:kworker.0 00010000:00080000:1.0:1789583855.657544:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b67c5f1180 x1876514332300672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583855.657555:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332300672:0@lo:400:kworker.0 00000100:00100000:1.0:1789583855.657574:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332300416:0@lo:8:kworker.0 00000400:00000100:1.0:1789583855.657614:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514332300416 offset 0 length 520: 4 00000100:00100000:1.0:1789583855.657630:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332300544:0@lo:8:kworker.0 00000400:00000100:1.0:1789583855.657643:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876514332300544 offset 0 length 520: 4 00010000:00010000:3.0:1789583856.043980:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583857.070471:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789583857.385328:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789583858.087885:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789583858.209615:0:15111:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789583858.209619:0:15111:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789583858.209736:0:15111:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b67baec000 00000020:01000004:3.0:1789583858.209752:0:15111:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789583858.209764:0:15111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789583858.209778:0:15111:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88b662298000) 00000020:00000080:3.0:1789583858.209794:0:15111:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789583858.238703:0:15111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789583858.239233:0:15111:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789583858.240385:0:15111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789583858.241754:0:15111:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789583858.243283:0:15111:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789583858.243750:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789583858.244084:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789583858.244230:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789583858.244715:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 770: rc = 0 00100000:10000000:3.0:1789583858.246334:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 770: rc = 0 00100000:10000000:3.0:1789583858.247308:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1789583858.247559:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1789583858.252793:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1789583858.253300:0:15111:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 770: rc = 0 00000020:00000080:3.0:1789583858.254752:0:15111:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789583858.254765:0:15111:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789583858.254776:0:15111:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d3e73d72c6e3f44 00000020:01000004:3.0:1789583858.254784:0:15111:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789583858.254894:0:15111:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789583858.254898:0:15111:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789583858.254905:0:15111:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789583858.256713:0:15111:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789583858.256735:0:15111:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff88b67c4bcd40) 00000020:00000080:2.0:1789583858.256753:0:15111:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789583858.260108:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789583858.260294:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789583858.260301:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789583858.268716:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789583858.268730:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789583858.276650:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789583858.276671:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789583858.279632:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789583858.280370:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789583858.280380:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789583858.285850:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789583858.286053:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789583858.315423:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789583858.315641:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789583858.315647:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789583858.317767:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789583858.317793:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789583858.318800:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789583858.318953:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789583858.321385:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789583858.321582:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789583858.321588:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789583858.328605:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789583858.328620:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789583858.403614:0:15111:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789583858.404324:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789583858.404331:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789583858.405492:0:15111:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789583858.405503:0:15111:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789583858.406623:0:15111:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789583858.406647:0:15111:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789583858.406653:0:15111:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789583858.434630:0:15111:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789583858.434676:0:15111:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.146@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789583858.434682:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789583858.434688:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789583858.434690:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583858.434691:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583858.434692:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583858.434694:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583858.434695:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583858.434696:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583858.434697:0:15111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583858.434701:0:15111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789583858.434703:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789583858.434705:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789583858.434706:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583858.434707:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583858.434707:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583858.434708:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583858.434709:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583858.434710:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583858.434711:0:15111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789583858.434750:0:15111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789583858.434771:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332300800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789583858.435021:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583858.435078:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b652ef3180 going to sleep for 11 seconds 00000100:00100000:3.0:1789583858.435244:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332300800 00000100:00100000:3.0:1789583858.435251:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332300800 00000100:00100000:3.0:1789583858.435299:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789583858.435307:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:15111:x1876514332300800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789583858.435346:0:14425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789583858.435349:0:14425:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789583858.435353:0:14425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789583858.451061:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:15111:x1876514332300800:12345-0@lo:253:mount.lustre.0 Request processed in 15746us (16031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583858.451075:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789583858.451240:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332300800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789583858.451254:0:15111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789583858.451257:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789583858.451259:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789583858.451260:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789583858.451261:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789583858.451262:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789583858.451263:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789583858.451265:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789583858.451266:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789583858.451267:0:15111:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789583858.451285:0:15111:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b67baec000 from lustre-OST0000 10000000:01000000:0.0:1789583858.451332:0:15111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789583858.451335:0:15111:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789583858.451341:0:15111:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88b67c5b4d40 local copy 00010000:00010000:0.0:1789583858.451356:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583858.451568:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332300928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583858.451600:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583858.451644:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b647de7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789583858.451659:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332300928 00000100:00100000:2.0:1789583858.451677:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332300928 00000100:00100000:2.0:1789583858.451720:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789583858.451728:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:15111:x1876514332300928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789583858.451894:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:15111:x1876514332300928:12345-0@lo:501:mount.lustre.0 Request processed in 166us (293us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789583858.451901:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789583858.452032:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332300928:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789583858.452045:0:15111:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789583858.452207:0:15111:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789583858.452214:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.452228:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583858.452247:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b67baec000 10000000:01000000:1.0:1789583858.452251:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789583858.452255:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff88b67c5b4d40 10000000:01000000:1.0:1789583858.452267:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789583858.452271:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff88b67c5b4d40 from 1 10000000:01000000:1.0:1789583858.452274:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789583858.452300:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.452308:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.452317:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583858.452332:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789583858.452362:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.452400:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66197f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789583858.452854:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301056 00000100:00100000:3.0:1789583858.452860:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301056 00000100:00100000:3.0:1789583858.452898:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789583858.452905:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+12:15111:x1876514332301056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583858.452914:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583858.452926:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b641483200/0x6d3e73d72c6e3f59 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3f52 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.452958:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b641483200/0x6d3e73d72c6e3f59 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f52 expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.452967:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b641483200/0x6d3e73d72c6e3f59 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f52 expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.452974:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483200, rc 0) 00000100:00100000:3.0:1789583858.453017:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+13:15111:x1876514332301056:12345-0@lo:101:mount.lustre.0 Request processed in 112us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583858.453022:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789583858.454473:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789583858.454499:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f59 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.454511:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3f59 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583858.454551:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789583858.454570:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f59 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.454577:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb000/0x6d3e73d72c6e3f52 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f59 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583858.454585:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789583858.454589:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789583858.454595:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789583858.454598:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789583858.454622:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.454629:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.454637:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583858.454655:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789583858.454711:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.454755:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66197f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.454835:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301184 00000100:00100000:0.0:1789583858.454842:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301184 00000100:00100000:0.0:1789583858.454889:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789583858.454898:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+13:15111:x1876514332301184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583858.454908:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583858.454920:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b66df54c00/0x6d3e73d72c6e3f67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3f60 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583858.454937:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df54c00/0x6d3e73d72c6e3f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f60 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583858.454946:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b66df54c00/0x6d3e73d72c6e3f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f60 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583858.454954:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54c00, rc 0) 00000100:00100000:0.0:1789583858.454991:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301184:12345-0@lo:101:mount.lustre.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.454997:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789583858.456424:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789583858.456444:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f67 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.456454:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3f67 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583858.457089:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789583858.458342:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789583858.458568:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789583858.458607:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789583858.458632:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789583858.458680:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789583858.458711:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789583858.458736:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789583858.460672:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789583858.460695:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789583858.460798:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789583858.460892:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.460936:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b66197f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.461085:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301312 00000100:00100000:0.0:1789583858.461093:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301312 00000100:00100000:0.0:1789583858.461159:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789583858.461169:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583858.461546:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301312:12345-0@lo:501:mount.lustre.0 Request processed in 378us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.461553:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789583858.461713:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789583858.461749:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789583858.461786:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.461831:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.461906:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301440 00000100:00100000:1.0:1789583858.461910:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301440 00000100:00100000:1.0:1789583858.461934:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789583858.461940:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789583858.462301:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301440:12345-0@lo:503:mount.lustre.0 Request processed in 360us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.462309:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789583858.462381:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789583858.462906:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789583858.462963:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583858.463000:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.463032:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.463107:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301568 00000100:00100000:0.0:1789583858.463112:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301568 00000100:00100000:0.0:1789583858.463157:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789583858.463164:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b68207a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789583858.463345:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b68207a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301568:12345-0@lo:502:mount.lustre.0 Request processed in 180us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.463352:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789583858.463500:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789583858.463696:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789583858.463737:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789583858.463762:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789583858.463799:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789583858.463861:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789583858.463886:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789583858.463922:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789583858.463948:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789583858.463972:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789583858.464032:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789583858.464063:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789583858.464097:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789583858.464132:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583858.464172:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.464199:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6813cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.464394:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301696 00000100:00100000:1.0:1789583858.464399:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301696 00000100:00100000:1.0:1789583858.464429:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789583858.464436:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b682078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583858.464600:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b682078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301696:12345-0@lo:502:mount.lustre.0 Request processed in 163us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.464607:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789583858.464706:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583858.464775:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789583858.464785:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789583858.468359:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789583858.468371:0:15125:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789583858.468379:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.468381:0:15125:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789583858.468389:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789583858.468406:0:15125:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff88b675533380) 00000020:00000080:1.0:1789583858.468429:0:15125:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789583858.468436:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789583858.468522:0:15125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b67baec000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789583858.468531:0:15125:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789583858.468542:0:15125:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d3e73d72c6e3f75 00010000:00010000:1.0:1789583858.477385:0:15125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789583858.477776:0:15125:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789583858.479232:0:15125:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789583858.488305:0:15125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789583858.488320:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789583858.488326:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.488328:0:15125:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789583858.488331:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789583858.488334:0:15125:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789583858.488335:0:15125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789583858.488337:0:15125:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789583858.488338:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789583858.488340:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.488341:0:15125:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789583858.488343:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789583858.488346:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.488347:0:15125:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789583858.488350:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789583858.488352:0:15125:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789583858.488353:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789583858.488355:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.488356:0:15125:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789583858.488359:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789583858.488370:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.488371:0:15125:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789583858.488375:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789583858.488434:0:15125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789583858.488438:0:15125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789583858.488439:0:15125:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789583858.488442:0:15125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789583858.488633:0:15111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789583858.488673:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789583858.488696:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f67 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.488707:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfaa00/0x6d3e73d72c6e3f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f67 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583858.488715:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b67baec000 from 1 10000000:01000000:3.0:1789583858.488718:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789583858.488753:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.488762:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.488797:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583858.488847:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789583858.488914:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583858.488952:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.489084:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301824 00000100:00100000:1.0:1789583858.489093:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301824 00000100:00100000:1.0:1789583858.489198:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789583858.489209:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b68207b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+14:15111:x1876514332301824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789583858.489221:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583858.489235:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3f7c expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.489256:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.489265:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 15 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.489274:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa200, rc 0) 00000100:00100000:1.0:1789583858.489320:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b68207b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332301824:12345-0@lo:101:mount.lustre.0 Request processed in 114us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.489328:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789583858.489408:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583858.489422:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.489431:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789583858.498557:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789583858.499087:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583858.500707:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789583858.500759:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789583858.500846:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789583858.500855:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789583858.500946:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583858.501011:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583858.501068:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.501260:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332301952 00000100:00100000:0.0:1789583858.501267:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332301952 00000100:00100000:0.0:1789583858.501313:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789583858.501322:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b682079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332301952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583858.501530:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b682079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332301952:12345-0@lo:501:mount.lustre.0 Request processed in 208us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.501538:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789583858.501660:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332301952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583858.501699:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789583858.501733:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583858.501762:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.503591:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302080 00000100:00100000:0.0:1789583858.503603:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302080 00000100:00100000:0.0:1789583858.503651:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789583858.503660:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789583858.503906:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302080:12345-0@lo:503:mount.lustre.0 Request processed in 246us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.503914:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789583858.504150:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789583858.504862:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789583858.504932:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789583858.504986:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583858.505027:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.505461:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302208 00000100:00100000:0.0:1789583858.505468:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302208 00000100:00100000:0.0:1789583858.505518:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789583858.505526:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789583858.505703:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302208:12345-0@lo:502:mount.lustre.0 Request processed in 177us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.505711:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789583858.506332:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583858.506608:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789583858.506654:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789583858.506722:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789583858.506752:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789583858.506776:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789583858.506848:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789583858.506886:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789583858.506921:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789583858.506954:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789583858.507004:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583858.507039:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b68123be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.507576:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302336 00000100:00100000:1.0:1789583858.507583:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302336 00000100:00100000:1.0:1789583858.507621:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789583858.507631:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583858.507840:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302336:12345-0@lo:502:mount.lustre.0 Request processed in 210us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.507854:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789583858.508024:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583858.508115:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789583858.508237:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789583858.509027:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583858.509036:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583858.509038:0:15129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789583858.509044:0:15129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b67baec000 00000020:00000080:0.0:1789583858.509046:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789583858.509052:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583858.509054:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583858.509055:0:15129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789583858.509057:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583858.509059:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583858.509060:0:15129:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789583858.509062:0:15129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b67baec000 00000020:00000080:0.0:1789583858.509064:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789583858.509111:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583858.509114:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583858.509115:0:15129:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789583858.509117:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789583858.509128:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583858.509129:0:15129:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789583858.509133:0:15129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88b67baec000 00000020:00000080:0.0:1789583858.509135:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789583858.509167:0:15129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789583858.509171:0:15129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789583858.509172:0:15129:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789583858.509175:0:15129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789583858.509343:0:15111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789583858.509366:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789583858.509388:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.509400:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583858.509440:0:15111:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789583858.509442:0:15111:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b67baec000 10000000:01000000:1.0:1789583858.509446:0:15111:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b67baec000 10000000:01000000:1.0:1789583858.509450:0:15111:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789583858.509455:0:15111:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b67baec000 from 1 10000000:01000000:1.0:1789583858.509457:0:15111:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789583858.509489:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.509496:0:15111:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.509505:0:15111:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583858.509525:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789583858.509574:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.509610:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f540 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.509627:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302464 00000100:00100000:1.0:1789583858.509633:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302464 00000100:00100000:1.0:1789583858.509684:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789583858.509691:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332302464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789583858.509702:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583858.509712:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b652cfa400/0x6d3e73d72c6e3f91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3f8a expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.509731:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfa400/0x6d3e73d72c6e3f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f8a expref: 16 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.509739:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b652cfa400/0x6d3e73d72c6e3f91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f8a expref: 16 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.509746:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfa400, rc 0) 00000100:00100000:1.0:1789583858.509775:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302464:12345-0@lo:101:mount.lustre.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.509936:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789583858.509986:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789583858.509999:0:15111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f91 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.510007:0:15111:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3f91 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789583858.511619:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789583858.511941:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789583858.512966:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789583858.513021:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789583858.513047:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789583858.513082:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789583858.514002:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789583858.514089:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789583858.515301:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789583858.515380:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789583858.515431:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789583858.515458:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789583858.515484:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789583858.515535:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789583858.515566:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789583858.515591:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789583858.515626:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789583858.515654:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789583858.515694:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789583858.515731:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789583858.515758:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789583858.515783:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789583858.515851:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789583858.515882:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789583858.515908:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789583858.515959:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789583858.515987:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789583858.516011:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789583858.516047:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789583858.516074:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789583858.519086:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789583858.519103:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789583858.519316:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789583858.519381:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.519479:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64447f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789583858.533082:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302592 00000100:00100000:0.0:1789583858.533099:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302592 00000100:00100000:0.0:1789583858.533173:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789583858.533181:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302592:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583858.533460:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302592:12345-0@lo:501:mount.lustre.0 Request processed in 278us (14078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583858.533466:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789583858.533914:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789583858.533961:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789583858.534010:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.534039:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.535383:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302720 00000100:00100000:1.0:1789583858.535392:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302720 00000100:00100000:1.0:1789583858.535436:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789583858.535449:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789583858.537592:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302720:12345-0@lo:503:mount.lustre.0 Request processed in 2135us (3573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.537605:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789583858.539766:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789583858.546517:0:15111:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789583858.546607:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583858.546703:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.546755:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.546901:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302848 00000100:00100000:1.0:1789583858.546908:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302848 00000100:00100000:1.0:1789583858.546946:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789583858.546953:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583858.547142:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302848:12345-0@lo:502:mount.lustre.0 Request processed in 188us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.547149:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789583858.547259:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789583858.547656:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789583858.547718:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789583858.547752:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789583858.548007:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789583858.548043:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789583858.548080:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789583858.548107:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789583858.548132:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789583858.548183:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789583858.548211:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789583858.548236:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789583858.548271:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789583858.548303:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789583858.548338:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789583858.548398:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789583858.548437:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789583858.548472:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789583858.548521:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789583858.548558:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789583858.548586:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789583858.548621:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789583858.548658:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789583858.555480:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789583858.555582:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789583858.555641:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789583858.555682:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789583858.555726:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789583858.555754:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789583858.556211:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789583858.556272:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789583858.556308:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789583858.556343:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789583858.556375:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789583858.556423:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789583858.556451:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789583858.556486:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789583858.556516:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789583858.556550:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789583858.556597:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789583858.556625:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789583858.560234:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583858.560315:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.560362:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.561238:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332302976 00000100:00100000:1.0:1789583858.561248:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332302976 00000100:00100000:1.0:1789583858.561301:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789583858.561310:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583858.561567:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332302976:12345-0@lo:502:mount.lustre.0 Request processed in 257us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.561576:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789583858.561960:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332302976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789583858.562097:0:15111:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789583858.562114:0:15111:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789583858.566929:0:15134:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789583858.566956:0:15134:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff88b66de2cd40) 00000020:00000080:0.0:1789583858.566976:0:15134:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789583858.567042:0:15134:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b67baec000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789583858.567046:0:15134:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b67baec000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789583858.567049:0:15134:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b67baec000 3 00010000:00080000:0.0:1789583858.567075:0:15134:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b67bafd800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.146@tcp at head 00010000:00010000:0.0:1789583858.568732:0:15134:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1789583858.570549:0:15134:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789583858.570588:0:15134:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789583858.570600:0:15134:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6d3e73d72c6e3f9f 00000100:00080000:2.0:1789583858.570610:0:15134:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789583858.570620:0:15134:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff88b67bafd800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583858.570652:0:15134:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763ca300 x1876514332303104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789583858.570727:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876514332303104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789583858.570800:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789583858.571711:0:15134:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789583858.571754:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789583858.571760:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789583858.571762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789583858.571765:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789583858.572154:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332303232:0@lo:400:kworker.0 00000100:00100000:1.0:1789583858.572203:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583858.572346:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303104 00000100:00100000:2.0:1789583858.572355:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303104 00000100:00100000:2.0:1789583858.572385:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303232 00000100:00100000:2.0:1789583858.572388:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303232 00000100:00100000:2.0:1789583858.572416:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583858.572424:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332303232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583858.572481:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332303232:12345-0@lo:400:kworker.0 Request processed in 57us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583858.572488:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583858.572506:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789583858.572511:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3304:x1876514332303104:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789583858.572531:0:14431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:2.0:1789583858.572574:0:14431:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6d3e73d72c6e3fa6 00000004:00100000:2.0:1789583858.572588:0:14431:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789583858.572621:0:14431:0:(import.c:65:import_set_state_nolock()) ffff88b6445de800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1789583858.572712:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b6763ca680 x1876514332303232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583858.572726:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332303232:0@lo:400:kworker.0 00000040:00080000:0.0:1789583858.575147:0:15134:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1789583858.576457:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876514332303104:12345-0@lo:38:llog_process_th.0 Request processed in 3938us (5649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583858.576471:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789583858.576645:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff88b6763ca300 x1876514332303104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789583868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583858.576658:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789583858.576679:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789583858.576696:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789583858.576701:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789583858.576706:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b67bafd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789583858.576714:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3304:1876514332303104:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789583858.576748:0:15111:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789583858.577097:0:15111:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789583858.577182:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f91 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583858.577195:0:15111:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb600/0x6d3e73d72c6e3f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3f91 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789583858.577715:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789583858.577722:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789583858.577728:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583858.577730:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583858.577731:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583858.577732:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583858.577734:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583858.577736:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583858.577737:0:15111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583858.577740:0:15111:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789583858.577743:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789583858.577744:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789583858.577745:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583858.577746:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583858.577747:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583858.577748:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583858.577749:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583858.577750:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583858.577750:0:15111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583858.577781:0:15111:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789583858.577797:0:15111:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332303360:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789583858.577880:0:15111:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.577920:0:15111:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a60f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583858.578195:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303360 00000100:00100000:3.0:1789583858.578202:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303360 00000100:00100000:3.0:1789583858.578246:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789583858.578255:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15111:x1876514332303360:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789583858.578280:0:14423:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789583858.578293:0:14423:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789583858.625387:0:14423:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789583858.625399:0:14423:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789583858.625428:0:14446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789583858.625433:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789583858.625454:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625472:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625480:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625519:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 16 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625547:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 16 pid: 14423 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583858.625563:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1876514332303488:0@lo:104: 00000100:00100000:1.0:1789583858.625625:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.625679:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a6ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1789583858.625709:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303488 00000100:00100000:1.0:1789583858.625717:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303488 00000100:00100000:1.0:1789583858.625759:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583858.625768:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14446:x1876514332303488:12345-0@lo:104: 00010000:00010000:1.0:1789583858.625780:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625851:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789583858.625857:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14446:x1876514332303488:12345-0@lo:104: Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.625864:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583858.625906:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1876514332303488:0@lo:104: 00010000:00010000:1.0:1789583858.625922:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625938:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583858.625944:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625950:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:1.0:1789583858.625954:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.625968:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789583858.625975:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789583858.625980:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789583858.626006:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626012:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789583858.626031:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626038:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfb200/0x6d3e73d72c6e3f13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f1a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626053:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583858.626054:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583858.626056:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583858.626078:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332303616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583858.626106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583858.626401:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303616 00000100:00100000:1.0:1789583858.626407:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303616 00010000:00010000:1.0:1789583858.626423:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 17 pid: 14423 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583858.626484:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583858.626492:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:3307:x1876514332303616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789583858.626509:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583858.626515:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 17 pid: 14423 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626524:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 17 pid: 14423 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626536:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b641482200/0x6d3e73d72c6e3f1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f13 expref: 17 pid: 14423 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626548:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626556:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789583858.626568:0:14417:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001136544s 00010000:00010000:1.0:1789583858.626572:0:14417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626578:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626585:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626591:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626596:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583858.626600:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626613:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626633:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583858.626642:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583858.626683:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3307:x1876514332303616:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.626690:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789583858.626738:0:14446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583858.626746:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583858.626758:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfa000/0x6d3e73d72c6e3fad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583858.626908:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332303616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583858.632336:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:15111:x1876514332303360:12345-0@lo:253:mount.lustre.0 Request processed in 54073us (54447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583858.632351:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789583858.632527:0:15111:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15111:1876514332303360:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789583858.632543:0:15111:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789583858.632546:0:15111:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789583858.632548:0:15111:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789583858.632549:0:15111:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789583858.632551:0:15111:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789583858.632552:0:15111:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789583858.632553:0:15111:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789583858.632555:0:15111:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789583858.632557:0:15111:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789583858.632558:0:15111:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789583858.632571:0:15111:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789583858.636794:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583858.637142:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789583858.637384:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583858.637513:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789583858.637632:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583858.637938:0:15111:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789583858.638659:0:15111:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789583858.688573:0:15111:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789583858.688583:0:15111:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789583858.688617:0:15111:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789583858.688679:0:15111:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789583858.688697:0:15111:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789583858.688724:0:15111:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789583859.118355:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583860.134955:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789583860.647655:0:14427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789583860.647663:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b674c49000 from 7 10000000:01000000:1.0:1789583860.647667:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789583860.647711:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583860.647723:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583860.647735:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583860.647759:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332303744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789583860.647842:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583860.647907:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6622e5180 going to sleep for 11 seconds 00000100:00100000:2.0:1789583860.648089:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303744 00000100:00100000:2.0:1789583860.648097:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303744 00000100:00100000:2.0:1789583860.648147:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789583860.648157:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+15:14427:x1876514332303744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583860.648171:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583860.648185:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e3fb4 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583860.648208:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583860.648219:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 16 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583860.648227:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1800, rc 0) 00000100:00100000:2.0:1789583860.648620:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:14427:x1876514332303744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 463us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583860.648628:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789583860.649974:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332303744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583860.649997:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583860.650008:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583860.650074:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332303872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789583860.650122:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583860.650161:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b661c20240 going to sleep for 11 seconds 00000100:00100000:1.0:1789583860.650445:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332303872 00000100:00100000:1.0:1789583860.650452:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332303872 00000100:00100000:1.0:1789583860.650541:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789583860.650551:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:14427:x1876514332303872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789583860.650569:0:14423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789583860.650584:0:14423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789583860.650587:0:14423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789583860.650695:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:14427:x1876514332303872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583860.650702:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789583860.650768:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332303872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789583860.650838:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789583860.650846:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583860.650864:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583861.164068:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583862.183696:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583863.206988:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789583863.852322:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789583863.852328:0:13980:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789583863.852332:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789583863.852335:0:13980:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789583863.852439:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332304000:0@lo:400:kworker.0 00000100:00100000:1.0:1789583863.852508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583863.852583:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789583863.852663:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583863.852668:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332304256:0@lo:400:kworker.0 00000100:00100000:3.0:1789583863.852703:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583863.852704:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304000 00000100:00100000:1.0:1789583863.852713:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304000 00000100:00100000:3.0:1789583863.852747:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304128 00000100:00100000:3.0:1789583863.852752:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304128 00000100:00100000:1.0:1789583863.852763:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789583863.852776:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3308:x1876514332304000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583863.852779:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304256 00000100:00100000:3.0:1789583863.852784:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304256 00000100:00100000:3.0:1789583863.852826:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583863.852834:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332304128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583863.852852:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3308:x1876514332304000:12345-0@lo:400:kworker.0 Request processed in 79us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583863.852861:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789583863.852892:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332304128:12345-0@lo:400:kworker.0 Request processed in 58us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583863.852898:0:14432:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789583863.852901:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789583863.852909:0:14432:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789583863.852920:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583863.852927:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332304256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583863.852956:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332304256:12345-0@lo:400:kworker.0 Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583863.852962:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789583863.852993:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583863.853027:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763e8a80 x1876514332304256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789583863.853027:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763ea300 x1876514332304128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583863.853044:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332304128:0@lo:400:kworker.0 00000100:00100000:1.0:1789583863.853080:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332304000:0@lo:400:kworker.0 00000100:00100000:3.0:1789583863.855386:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332304256:0@lo:400:kworker.0 00010000:00010000:1.0:1789583864.238916:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789583865.232082:0:15479:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789583865.255052:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583866.282219:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583867.303009:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789583867.625422:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789583868.333446:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789583868.967888:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789583868.967894:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789583868.967897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789583868.967899:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789583868.967938:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332304384:0@lo:400:kworker.0 00000100:00100000:3.0:1789583868.968002:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583868.968053:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789583868.968060:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332304512:0@lo:400:kworker.0 00000100:00100000:3.0:1789583868.968084:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583868.968113:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332304640:0@lo:400:kworker.0 00000100:00100000:3.0:1789583868.968145:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583868.968179:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304512 00000100:00100000:3.0:1789583868.968185:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304512 00000100:00100000:3.0:1789583868.968226:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304640 00000100:00100000:3.0:1789583868.968229:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304640 00000100:00100000:3.0:1789583868.968259:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583868.968267:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332304512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583868.968313:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876514332304512:12345-0@lo:400:kworker.0 Request processed in 47us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583868.968320:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583868.968337:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789583868.968343:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332304640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583868.968376:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332304640:12345-0@lo:400:kworker.0 Request processed in 34us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583868.968382:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789583868.968404:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789583868.968431:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763eb100 x1876514332304640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583868.968445:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332304640:0@lo:400:kworker.0 00010000:00080000:3.0:1789583868.968471:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763eb480 x1876514332304512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583868.968479:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876514332304512:0@lo:400:kworker.0 00000100:00100000:1.0:1789583868.970851:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304384 00000100:00100000:1.0:1789583868.970867:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304384 00000100:00100000:1.0:1789583868.970920:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789583868.970928:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3307:x1876514332304384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583868.971011:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3307:x1876514332304384:12345-0@lo:400:kworker.0 Request processed in 84us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583868.971017:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789583868.971488:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332304384:0@lo:400:kworker.0 00010000:00010000:3.0:1789583869.355618:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583870.383445:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583870.824006:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583855/real 1789583855] req@ffff88b67c5f3b80 x1876514332300416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583870 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583870.824061:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b67c5f3b80 x1876514332300416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583870 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583870.824071:0:3304:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789583855/real 1789583855] req@ffff88b67c5f3480 x1876514332300544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583870 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583870.824082:0:3304:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff88b67c5f3480 x1876514332300544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789583870 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789583870.824100:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b66e246800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789583870.824119:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789583870.824123:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332300416:0@lo:8:kworker.0 00000100:00080000:3.0:1789583870.824128:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789583870.824133:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789583870.824136:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332300544:0@lo:8:kworker.0 00000100:00080000:2.0:1789583870.824237:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789583870.824241:0:13980:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789583870.824244:0:13980:0:(import.c:65:import_set_state_nolock()) ffff88b66e246800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789583870.824249:0:13980:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:2.0:1789583870.824263:0:13980:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789583870.824274:0:13980:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff88b66e246800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583870.824292:0:13980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763c9880 x1876514332304896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789583870.824314:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789583870.824317:0:13980:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789583870.824319:0:13980:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789583870.824321:0:13980:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:2.0:1789583870.824324:0:13980:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789583870.824328:0:13980:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b6444c7000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583870.824338:0:13980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763c9f80 x1876514332305024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789583870.824383:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332305280:0@lo:400:kworker.0 00000100:00100000:2.0:1789583870.824446:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583870.824498:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789583870.824504:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332305152:0@lo:400:kworker.0 00000100:00100000:2.0:1789583870.824525:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583870.824555:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305280 00000100:00100000:2.0:1789583870.824561:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305280 00000100:00100000:2.0:1789583870.824620:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305152 00000100:00100000:2.0:1789583870.824624:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305152 00000100:00100000:2.0:1789583870.824646:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789583870.824654:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332305280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583870.824701:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332305280:12345-0@lo:400:kworker.0 Request processed in 48us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583870.824708:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789583870.824725:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789583870.824732:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583870.824758:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332305152:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583870.824763:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789583870.824782:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789583870.824841:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763cb800 x1876514332305152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583870.824853:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332305152:0@lo:400:kworker.0 00010000:00080000:2.0:1789583870.824863:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763c8e00 x1876514332305280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583870.824870:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332305280:0@lo:400:kworker.0 00000100:00100000:3.0:1789583870.825047:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332304768:0@lo:400:kworker.0 00000100:00100000:3.0:1789583870.825082:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583870.825194:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332304896:0@lo:8:kworker.0 00000100:00100000:1.0:1789583870.825225:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583870.825262:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332305024:0@lo:8:kworker.0 00000100:00100000:1.0:1789583870.825284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583870.825434:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304896 00000100:00100000:3.0:1789583870.825440:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304896 00000100:00100000:3.0:1789583870.825467:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305024 00000100:00100000:3.0:1789583870.825470:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305024 00000100:00100000:3.0:1789583870.825484:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789583870.825489:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876514332304896:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789583870.825511:0:15112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:3.0:1789583870.825541:0:15112:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e3fc2 00002000:00100000:3.0:1789583870.825554:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff88b676cd7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789583870.825566:0:15112:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789583870.825580:0:15112:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789583870.825920:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789583870.825942:0:15112:0:(import.c:65:import_set_state_nolock()) ffff88b676cd4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789583870.825985:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876514332304896:12345-0@lo:8:kworker.0 Request processed in 495us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583870.825992:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789583870.826010:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789583870.826014:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876514332305024:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789583870.826025:0:15112:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789583870.826048:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3304:x1876514332305024:12345-0@lo:8:kworker.0 Request processed in 32us (763us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789583870.826054:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789583870.826338:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763c9880 x1876514332304896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789583890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583870.826348:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789583870.826355:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789583870.826362:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789583870.826366:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789583870.826369:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b66e246800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789583870.826391:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789583870.826396:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332304896:0@lo:8:kworker.0 00000100:00080000:1.0:1789583870.826416:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789583870.826421:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789583870.826424:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332305024:0@lo:8:kworker.0 00000100:00100000:2.0:1789583870.826509:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332304768 00000100:00100000:2.0:1789583870.826522:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332304768 00000100:00100000:2.0:1789583870.826559:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789583870.826567:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3306:x1876514332304768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583870.826622:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:3306:x1876514332304768:12345-0@lo:400:kworker.0 Request processed in 56us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583870.826628:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789583870.826665:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332304768:0@lo:400:kworker.0 00000004:00080000:3.0:1789583870.826751:0:14453:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789583870.826768:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1876514332305536:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789583870.826800:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583870.826843:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b543d68000 going to sleep for 11 seconds 00000004:00080000:3.0:1789583870.826856:0:14452:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789583870.827070:0:14452:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427811262668ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789583870.827090:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305536 00000100:00100000:3.0:1789583870.827094:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305536 00000100:00100000:3.0:1789583870.827121:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583870.827127:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14453:x1876514332305536:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789583870.827827:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332305408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583870.827907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583870.829122:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305408 00000100:00100000:2.0:1789583870.829131:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305408 00000100:00100000:2.0:1789583870.829184:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583870.829193:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332305408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789583870.829249:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789583870.832874:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332305408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3674us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583870.832887:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789583870.832925:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789583870.833287:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763eb480 x1876514332305408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789583870.833315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332305408:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789583870.836917:0:15112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789583870.836927:0:15112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789583870.836934:0:15112:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1789583870.851439:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.851452:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851469:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.851474:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.851481:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851499:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851510:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851518:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851537:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.851552:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.851557:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851565:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483a00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.851581:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851604:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851620:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851629:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e3fc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.851648:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.851649:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.851651:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.852153:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.852159:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.854148:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.854154:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.854162:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.854542:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.854554:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.854568:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.855331:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.855348:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.855356:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.855366:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.855370:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.855379:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.855395:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.855403:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e3fd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.855423:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.855425:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.855427:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.856046:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.856062:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856073:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.856077:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.856082:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856093:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856101:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856108:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856122:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.856131:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.856136:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856143:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.856147:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856155:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856175:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856183:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e3fd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856196:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.856198:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.856199:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.856686:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.856693:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856702:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.856706:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.856710:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856720:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856727:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856735:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856762:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.856772:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.856776:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856783:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216fc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.856786:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856794:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856833:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856841:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e3fde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.856857:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.856858:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.856860:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.857251:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.857257:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857266:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.857275:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.857280:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857289:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857297:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857304:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857318:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.857327:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.857331:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857337:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.857341:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857348:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857359:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857377:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e3fe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.857391:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.857392:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.857394:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.858498:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.858506:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.858769:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.858774:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.858780:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.858792:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.858801:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.858830:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.859128:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.859140:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.859151:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.859160:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216ec00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.859379:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.859390:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.859406:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.859413:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e3fec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.859432:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.859435:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.859437:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789583870.868606:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789583870.868621:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.868637:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789583870.868642:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583870.868648:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.868664:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.868686:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.868695:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.868721:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.868789:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.869294:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.869429:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.869435:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.869460:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.869479:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.869487:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b569a635/0x6d3e73d72c6e3ff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.869510:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.869512:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.869515:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789583870.881068:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789583870.881081:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.881099:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789583870.881104:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583870.881110:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.881124:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.881134:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.881143:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.881851:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789583870.882338:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789583870.882345:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.882359:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789583870.882362:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583870.882368:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.882380:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.882389:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.882397:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882637:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789583870.882646:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882653:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583870.882657:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882666:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882685:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882692:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8e3d84f/0x6d3e73d72c6e3ffa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882712:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583870.882716:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882735:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583870.882738:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882745:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882756:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.882764:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.882765:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.882768:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.882951:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789583870.882957:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037fc646f/0x6d3e73d72c6e4001 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789583870.883916:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789583870.883924:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.883943:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789583870.883947:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583870.883953:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.883965:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.883973:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.883981:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.884027:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583870.884035:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.884042:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583870.884046:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.884055:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.884070:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.884084:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.884085:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.884087:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.884154:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789583870.884159:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e33ff3c/0x6d3e73d72c6e4008 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789583870.884942:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789583870.884949:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.884960:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789583870.884966:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583870.884971:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.884993:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.885001:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.885008:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.885964:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583870.885973:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.885982:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583870.885987:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.885996:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.886013:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.886878:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.886882:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.886885:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.887602:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789583870.887613:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052f7df57/0x6d3e73d72c6e400f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789583870.889251:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.889263:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.889278:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.889283:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.889289:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.889304:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.889621:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.889630:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.889652:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789583870.890295:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.890364:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.890439:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.890443:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.890449:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.890461:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.890469:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.890476:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.890495:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789583870.891595:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.891605:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.891617:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.891620:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.891625:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.891637:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.891645:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.891651:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.891659:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789583870.893555:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.893565:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.893592:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.893604:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.893609:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.893622:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.893632:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.893638:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.893649:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789583870.893746:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789583870.893757:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893767:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216ec00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.893773:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893785:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893816:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893837:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073c3d747/0x6d3e73d72c6e4016 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893855:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789583870.893859:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893865:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.893869:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893877:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893887:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893895:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1fecf76/0x6d3e73d72c6e401d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893907:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789583870.893911:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893917:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216fc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.893925:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893933:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893942:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893950:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000198fc4fa/0x6d3e73d72c6e4024 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893962:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.893965:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893971:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.893974:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893982:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893991:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.893998:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000331a01b4/0x6d3e73d72c6e402b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.894017:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.894019:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.894021:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.894727:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.894734:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.894745:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.894748:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.894753:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.894764:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.894772:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.894784:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.894934:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583870.895117:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.895124:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.895133:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f800 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.895138:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.895147:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.895162:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.895170:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d96879c1/0x6d3e73d72c6e4032 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.895199:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.895202:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.895204:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.895713:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.896002:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896013:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.896017:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.896022:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896034:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896042:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896050:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896141:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583870.896157:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583870.896161:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896177:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583870.896181:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896190:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896204:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896210:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c05d75d/0x6d3e73d72c6e4039 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.896227:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.896229:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583870.896436:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.896936:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.897029:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.897035:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.897045:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.897049:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.897055:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.897510:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.897528:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.897536:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.897562:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583870.897607:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.897616:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.897639:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216e400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.897643:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.897653:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.897669:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.897677:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001497d179/0x6d3e73d72c6e4040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.897699:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.897702:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.897706:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.898978:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.898987:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.899000:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.899004:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.899010:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.899022:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.899031:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.899039:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.899146:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583870.899372:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583870.899379:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.899387:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216f600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583870.899391:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.899413:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.899428:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.899435:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf67cf47/0x6d3e73d72c6e4047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.899460:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.899462:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.899464:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789583870.899528:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789583870.902044:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.902059:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.902377:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.902382:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.902389:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.902405:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.902415:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.902423:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.902449:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583870.902555:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.902564:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.902585:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.902590:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.902600:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.902627:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.902636:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d2a695/0x6d3e73d72c6e404e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.902658:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.902661:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.902663:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.903677:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.903686:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.903698:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.903708:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.903724:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.903736:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.903743:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.903750:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.903771:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583870.903900:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583870.903907:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.903916:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641482200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583870.903920:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.903929:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.903942:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.903962:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009268b07a/0x6d3e73d72c6e4055 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583870.903981:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.903983:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.903985:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789583870.908170:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789583870.908185:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.908202:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1789583870.908207:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583870.908213:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.908227:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.908618:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.908639:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583870.908659:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583870.909327:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.909336:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.909347:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483a00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.909351:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.909362:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.909380:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.909388:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b52c7331/0x6d3e73d72c6e405c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.909425:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.909427:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.909428:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583870.912992:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583870.913007:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913026:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1789583870.913030:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583870.913037:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913055:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913243:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913253:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913276:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583870.913782:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583870.913788:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913843:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1789583870.913846:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583870.913851:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913862:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913871:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913879:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.913896:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789583870.914306:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583870.914312:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914321:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1789583870.914323:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583870.914328:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914337:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914356:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914363:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914372:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789583870.914762:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583870.914768:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914777:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1789583870.914780:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583870.914784:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914792:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914801:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914843:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.914862:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789583870.914878:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789583870.914888:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914899:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.914905:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914915:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914933:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914940:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4063 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914960:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789583870.914965:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914971:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.914981:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.914989:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915001:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915009:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2edde64/0x6d3e73d72c6e406a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915028:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789583870.915032:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915039:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.915043:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915050:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915063:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915069:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4071 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915090:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.915093:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915099:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfac00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.915102:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915110:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915121:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915129:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4078 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.915143:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.915146:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.915149:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583870.915276:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583870.915282:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.915290:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1789583870.915293:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583870.915297:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.915308:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.915316:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.915324:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583870.916031:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789583870.916459:0:15112:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789583870.916551:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14453:x1876514332305536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89419us (89745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583870.916564:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789583870.917061:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583870.917131:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.917142:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfba00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583870.917153:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.917165:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.917183:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.917191:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ab63d2/0x6d3e73d72c6e407f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583870.917211:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.917213:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583870.917215:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583870.918008:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583870.918620:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1876514332305536:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789583870.918640:0:14453:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789583870.918689:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1876514332305664:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789583870.918746:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583870.918820:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789583870.918986:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305664 00000100:00100000:2.0:1789583870.918994:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305664 00000100:00100000:2.0:1789583870.919044:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789583870.919054:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14453:x1876514332305664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789583870.919105:0:15114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1789583870.937075:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14453:x1876514332305664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18015us (18321us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789583870.937089:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789583870.938449:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14453:1876514332305664:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789583870.938466:0:14453:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789583871.400977:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583872.423018:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789583872.541340:0:15830:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789583872.541345:0:15830:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789583872.541478:0:15830:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88b666646800 00000020:01000004:0.0:1789583872.541495:0:15830:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789583872.541509:0:15830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789583872.541523:0:15830:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff88b66de28000) 00000020:00000080:0.0:1789583872.541541:0:15830:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789583872.569230:0:15830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789583872.569502:0:15830:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789583872.573250:0:15830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789583872.573494:0:15830:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789583872.575796:0:15830:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789583872.577440:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 461: rc = 0 00100000:10000000:2.0:1789583872.581482:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 461: rc = 0 00100000:10000000:2.0:1789583872.581844:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 461: rc = 0 00100000:10000000:3.0:1789583872.584421:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 373: rc = 0 00100000:10000000:3.0:1789583872.590523:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 373: rc = 0 00100000:10000000:3.0:1789583872.591204:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 373: rc = 0 00100000:10000000:3.0:1789583872.591455:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 373: rc = 0 00100000:10000000:3.0:1789583872.591701:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 373: rc = 0 00100000:10000000:3.0:1789583872.592417:0:15830:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 373: rc = 0 00000020:00000080:3.0:1789583872.593790:0:15830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789583872.593802:0:15830:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789583872.594050:0:15830:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d3e73d72c6e408d 00000020:01000004:3.0:1789583872.594059:0:15830:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789583872.594080:0:15830:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.146@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789583872.594090:0:15830:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.146@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789583872.594096:0:15830:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789583872.594119:0:15830:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789583872.594123:0:15830:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.146@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789583872.610425:0:15830:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.146@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789583872.610458:0:15830:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.146@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789583872.610463:0:15830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789583872.610468:0:15830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789583872.610470:0:15830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583872.610540:0:15830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583872.610543:0:15830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583872.610544:0:15830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583872.610545:0:15830:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789583872.610547:0:15830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583872.610548:0:15830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789583872.610552:0:15830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789583872.610554:0:15830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789583872.610621:0:15830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789583872.610624:0:15830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583872.610625:0:15830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583872.610626:0:15830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583872.610627:0:15830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583872.610628:0:15830:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789583872.610629:0:15830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583872.610630:0:15830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789583872.610657:0:15830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789583872.610677:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332305792:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789583872.610741:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.611090:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305792 00000100:00100000:1.0:1789583872.611098:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305792 00000100:00100000:2.0:1789583872.611185:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba540 going to sleep for 11 seconds 00000100:00100000:3.0:1789583872.611362:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789583872.611372:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15830:x1876514332305792:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789583872.611414:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789583872.611417:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789583872.611421:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789583872.620503:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15830:x1876514332305792:12345-0@lo:253:mount.lustre.0 Request processed in 9125us (9753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583872.620518:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789583872.620739:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332305792:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789583872.620754:0:15830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789583872.620757:0:15830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789583872.620759:0:15830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789583872.620760:0:15830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789583872.620762:0:15830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789583872.620763:0:15830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789583872.620764:0:15830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789583872.620765:0:15830:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789583872.620767:0:15830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789583872.620768:0:15830:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789583872.620787:0:15830:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88b666646800 from lustre-OST0001 10000000:01000000:2.0:1789583872.620840:0:15830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789583872.620843:0:15830:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789583872.620850:0:15830:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff88b67c5b4d40 local copy 00010000:00010000:2.0:1789583872.620879:0:15830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583872.621269:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332305920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789583872.621307:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583872.621349:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba900 going to sleep for 11 seconds 00000100:00100000:1.0:1789583872.621467:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332305920 00000100:00100000:1.0:1789583872.621483:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332305920 00000100:00100000:1.0:1789583872.621527:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789583872.621535:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15830:x1876514332305920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789583872.621832:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15830:x1876514332305920:12345-0@lo:501:mount.lustre.0 Request processed in 297us (524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583872.621840:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789583872.622052:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332305920:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789583872.622067:0:15830:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.146@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789583872.622306:0:15830:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.146@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789583872.622315:0:15830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.622324:0:15830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df54400/0x6d3e73d72c6e3e3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e3e41 expref: -99 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583872.622348:0:15830:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88b666646800 10000000:01000000:3.0:1789583872.622353:0:15830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789583872.622358:0:15830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789583872.622360:0:15830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789583872.622365:0:15830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789583872.622368:0:15830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789583872.622390:0:15830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.622405:0:15830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.622416:0:15830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583872.622431:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789583872.622462:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.622599:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789583872.623329:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306048 00000100:00100000:0.0:1789583872.623337:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306048 00000100:00100000:0.0:1789583872.623384:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789583872.623392:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:15830:x1876514332306048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583872.623404:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583872.623418:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b66df55000/0x6d3e73d72c6e409b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e4094 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.623440:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df55000/0x6d3e73d72c6e409b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4094 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.623450:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b66df55000/0x6d3e73d72c6e409b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4094 expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.623458:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df55000, rc 0) 00000100:00100000:0.0:1789583872.623530:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306048:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.623537:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789583872.623740:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583872.623754:0:15830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e409b expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.623765:0:15830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e409b expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789583872.628141:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789583872.629085:0:15830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583872.629338:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789583872.629381:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789583872.629408:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789583872.629452:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789583872.629489:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789583872.629523:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789583872.629600:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789583872.629609:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789583872.629688:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583872.629746:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.629794:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583872.631357:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306176 00000100:00100000:0.0:1789583872.631369:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306176 00000100:00100000:0.0:1789583872.631420:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789583872.631428:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583872.631849:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306176:12345-0@lo:501:mount.lustre.0 Request processed in 420us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.631858:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789583872.632239:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583872.632285:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789583872.632330:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.632362:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583872.634678:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306304 00000100:00100000:1.0:1789583872.634693:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306304 00000100:00100000:1.0:1789583872.634759:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789583872.634768:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306304:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789583872.639442:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306304:12345-0@lo:503:mount.lustre.0 Request processed in 4654us (7091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583872.639457:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789583872.639856:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789583872.643405:0:15830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789583872.643615:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789583872.643688:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.643736:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583872.643792:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306432 00000100:00100000:2.0:1789583872.643800:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306432 00000100:00100000:2.0:1789583872.644043:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789583872.644053:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583872.644279:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306432:12345-0@lo:502:mount.lustre.0 Request processed in 227us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.644287:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789583872.644375:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583872.644656:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789583872.644705:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789583872.644735:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789583872.644790:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789583872.644846:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789583872.644892:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789583872.644952:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789583872.645001:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789583872.645057:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789583872.645087:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789583872.645131:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.645819:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64566ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583872.645951:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306560 00000100:00100000:0.0:1789583872.645968:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306560 00000100:00100000:0.0:1789583872.646001:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789583872.646009:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789583872.646310:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306560:12345-0@lo:502:mount.lustre.0 Request processed in 300us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.646318:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789583872.646406:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583872.646569:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789583872.646584:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789583872.648221:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789583872.648232:0:15831:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789583872.648239:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583872.648241:0:15831:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789583872.648247:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789583872.648261:0:15831:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff88b648de8000) 00000020:00000080:2.0:1789583872.648281:0:15831:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789583872.648287:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789583872.648341:0:15831:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b666646800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789583872.648348:0:15831:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789583872.648354:0:15831:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d3e73d72c6e40a9 00010000:00010000:3.0:1789583872.653415:0:15831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789583872.654033:0:15831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789583872.659650:0:15831:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789583872.667104:0:15831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789583872.667119:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583872.667126:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583872.667128:0:15831:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789583872.667131:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583872.667134:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583872.667143:0:15831:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789583872.667147:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789583872.667149:0:15831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789583872.667220:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583872.667225:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583872.667226:0:15831:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789583872.667230:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789583872.667233:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583872.667234:0:15831:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789583872.667238:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789583872.667298:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789583872.667302:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789583872.667303:0:15831:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789583872.667306:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789583872.674265:0:15830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789583872.674313:0:15830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789583872.674380:0:15830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e409b expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674394:0:15830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641483a00/0x6d3e73d72c6e4094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e409b expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789583872.674420:0:15830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666646800 from 1 10000000:01000000:0.0:1789583872.674423:0:15830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789583872.674466:0:15830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674498:0:15830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674510:0:15830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583872.674535:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306688:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789583872.674614:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583872.674652:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b651163a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583872.674676:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306688 00000100:00100000:0.0:1789583872.674684:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306688 00000100:00100000:0.0:1789583872.674723:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789583872.674731:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:15830:x1876514332306688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583872.674744:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583872.674756:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e40b0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674779:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674790:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674798:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54e00, rc 0) 00000100:00100000:0.0:1789583872.674848:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332306688:12345-0@lo:101:mount.lustre.0 Request processed in 117us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.674854:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789583872.674918:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306688:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583872.674931:0:15830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.674940:0:15830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789583872.675419:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789583872.675823:0:15830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789583872.676048:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789583872.676092:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789583872.676155:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789583872.676162:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789583872.676217:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789583872.676257:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583872.676287:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b651163a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583872.676383:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306816 00000100:00100000:1.0:1789583872.676389:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306816 00000100:00100000:1.0:1789583872.676416:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789583872.676423:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332306816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789583872.676613:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332306816:12345-0@lo:501:mount.lustre.0 Request processed in 189us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583872.676625:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789583872.677305:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789583872.677341:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789583872.677384:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.677408:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332306944 00000100:00100000:1.0:1789583872.677412:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332306944 00000100:00100000:1.0:1789583872.677432:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789583872.677438:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332306944:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789583872.677580:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c501850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332306944:12345-0@lo:503:mount.lustre.0 Request processed in 141us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583872.677587:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789583872.677619:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583872.677630:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332306944:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789583872.678286:0:15830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789583872.678341:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583872.678379:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.678407:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307072 00000100:00100000:1.0:1789583872.678412:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307072 00000100:00100000:1.0:1789583872.678439:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789583872.678446:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332307072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583872.682418:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c500850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332307072:12345-0@lo:502:mount.lustre.0 Request processed in 3962us (4029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583872.682432:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789583872.682523:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789583872.682570:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789583872.683188:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789583872.683250:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789583872.683295:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789583872.683333:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789583872.683365:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789583872.683413:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789583872.683446:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789583872.683494:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789583872.683531:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789583872.683603:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.683643:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583872.684061:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307200 00000100:00100000:2.0:1789583872.684069:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307200 00000100:00100000:2.0:1789583872.684107:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789583872.684115:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332307200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583872.684314:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c502050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332307200:12345-0@lo:502:mount.lustre.0 Request processed in 199us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.684322:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789583872.684374:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307200:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789583872.684463:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789583872.684475:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789583872.688244:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583872.688255:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583872.688257:0:15835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789583872.688264:0:15835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b666646800 00000020:00000080:3.0:1789583872.688266:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789583872.688273:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583872.688275:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583872.688277:0:15835:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789583872.688279:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583872.688282:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583872.688283:0:15835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789583872.688286:0:15835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88b666646800 00000020:00000080:3.0:1789583872.688288:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789583872.688343:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583872.688347:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583872.688348:0:15835:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789583872.688351:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789583872.688353:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583872.688355:0:15835:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789583872.688358:0:15835:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88b666646800 00000020:00000080:3.0:1789583872.688360:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789583872.688390:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789583872.688393:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789583872.688394:0:15835:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789583872.688397:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789583872.689974:0:15830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789583872.690009:0:15830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583872.690035:0:15830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.690058:0:15830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583872.690101:0:15830:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789583872.690104:0:15830:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88b666646800 10000000:01000000:3.0:1789583872.690107:0:15830:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88b666646800 10000000:01000000:3.0:1789583872.690111:0:15830:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789583872.690117:0:15830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88b666646800 from 1 10000000:01000000:3.0:1789583872.690119:0:15830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789583872.690539:0:15830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.690548:0:15830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.690627:0:15830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583872.690653:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789583872.690714:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.692933:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba540 going to sleep for 11 seconds 00000100:00100000:0.0:1789583872.706039:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307328 00000100:00100000:0.0:1789583872.706054:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307328 00000100:00100000:0.0:1789583872.706109:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789583872.706119:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332307328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789583872.706135:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583872.706670:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e40c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e40be expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.706705:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e40c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40be expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.706717:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b66df55800/0x6d3e73d72c6e40c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40be expref: 19 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583872.706739:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df55800, rc 0) 00000100:00100000:0.0:1789583872.706828:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c503c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307328:12345-0@lo:101:mount.lustre.0 Request processed in 710us (16113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.706836:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789583872.707106:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789583872.707125:0:15830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40c5 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583872.707134:0:15830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e40c5 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789583872.712782:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789583872.714846:0:15830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789583872.716315:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789583872.716363:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789583872.716394:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789583872.716435:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789583872.716467:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789583872.716526:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789583872.716574:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789583872.716610:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789583872.716654:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789583872.716686:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789583872.716715:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789583872.716757:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789583872.716788:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789583872.716840:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789583872.716902:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789583872.716935:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789583872.716965:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789583872.717013:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789583872.717049:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789583872.717082:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789583872.717127:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789583872.717158:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789583872.717186:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789583872.717231:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789583872.717263:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789583872.717294:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789583872.717335:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789583872.717366:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789583872.717394:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789583872.717448:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789583872.717482:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789583872.717515:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789583872.717547:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789583872.720722:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789583872.720770:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789583872.721284:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789583872.721331:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789583872.721421:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789583872.721430:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789583872.721539:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583872.721611:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.721653:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307456 00000100:00100000:3.0:1789583872.721659:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307456 00000100:00100000:2.0:1789583872.725276:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a25d780 going to sleep for 11 seconds 00000100:00100000:3.0:1789583872.725650:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789583872.725670:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789583872.727299:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c501c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307456:12345-0@lo:501:mount.lustre.0 Request processed in 1632us (5680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583872.727310:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789583872.727623:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789583872.727672:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307584:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789583872.727716:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583872.727756:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b645fde600 going to sleep for 11 seconds 00000100:00100000:3.0:1789583872.728013:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307584 00000100:00100000:3.0:1789583872.728020:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307584 00000100:00100000:3.0:1789583872.728058:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789583872.728066:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307584:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789583872.729977:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c503850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307584:12345-0@lo:503:mount.lustre.0 Request processed in 1906us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583872.729990:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789583872.730098:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789583872.735070:0:15830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789583872.735187:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789583872.735256:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.735301:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a25de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583872.735746:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307712 00000100:00100000:2.0:1789583872.735753:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307712 00000100:00100000:2.0:1789583872.735796:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789583872.735826:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789583872.736074:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c500450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307712:12345-0@lo:502:mount.lustre.0 Request processed in 269us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.736082:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789583872.736364:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583872.736782:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789583872.737042:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789583872.737078:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789583872.737139:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789583872.737254:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789583872.737301:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789583872.737337:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789583872.737370:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789583872.737413:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789583872.737447:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789583872.740143:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789583872.740273:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789583872.740307:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789583872.740337:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789583872.740403:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789583872.740437:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789583872.740467:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789583872.740843:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789583872.741033:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789583872.741074:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789583872.741124:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789583872.741157:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789583872.741189:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789583872.741233:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789583872.741265:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789583872.741296:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789583872.741340:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789583872.741387:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789583872.741419:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789583872.741763:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789583872.742111:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789583872.742162:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789583872.742198:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789583872.742249:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789583872.742284:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789583872.742330:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789583872.742364:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789583872.742394:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789583872.742453:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789583872.742717:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789583872.742768:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789583872.747217:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.747267:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a25de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789583872.747681:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307840 00000100:00100000:0.0:1789583872.747689:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307840 00000100:00100000:0.0:1789583872.747740:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789583872.747750:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789583872.748068:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c502850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332307840:12345-0@lo:502:mount.lustre.0 Request processed in 319us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.748077:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789583872.748752:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332307840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789583872.748917:0:15830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789583872.748933:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789583872.755145:0:15840:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789583872.755217:0:15840:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff88b648de99c0) 00000020:00000080:2.0:1789583872.755240:0:15840:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789583872.755335:0:15840:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88b666646800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789583872.755340:0:15840:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88b666646800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789583872.755343:0:15840:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88b666646800 3 00010000:00080000:2.0:1789583872.755371:0:15840:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88b67baff800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.146@tcp at head 00010000:00010000:2.0:1789583872.758433:0:15840:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789583872.758788:0:15840:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789583872.758913:0:15840:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789583872.758925:0:15840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6d3e73d72c6e40d3 00000100:00080000:2.0:1789583872.758936:0:15840:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789583872.758946:0:15840:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88b67baff800 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:2.0:1789583872.758989:0:15840:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6763cb800 x1876514332307968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789583872.759010:0:15840:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789583872.759383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789583872.759388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789583872.759391:0:37:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789583872.759396:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:0.0:1789583872.759400:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789583872.759405:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b6444c7000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:0.0:1789583872.759418:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b6752a0a80 x1876514332308224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789583872.759457:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789583872.759480:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332308096:0@lo:400:kworker.0 00000100:00100000:0.0:1789583872.759545:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583872.759844:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332308480:0@lo:400:kworker.0 00000100:00100000:2.0:1789583872.760042:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583872.760063:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789583872.760069:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332308352:0@lo:400:kworker.0 00000100:00100000:2.0:1789583872.760102:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583872.760134:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308480 00000100:00100000:2.0:1789583872.760140:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308480 00000100:00100000:2.0:1789583872.760259:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308352 00000100:00100000:2.0:1789583872.760263:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308352 00000100:00100000:2.0:1789583872.760281:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789583872.760288:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332308480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583872.760349:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876514332308480:12345-0@lo:400:kworker.0 Request processed in 61us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.760357:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789583872.760372:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789583872.760378:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332308352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583872.760402:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332308352:12345-0@lo:400:kworker.0 Request processed in 25us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.760408:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789583872.760423:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789583872.760453:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6752a0e00 x1876514332308352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789583872.760466:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332308352:0@lo:400:kworker.0 00000100:00100000:1.0:1789583872.760521:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308096 00000100:00100000:1.0:1789583872.760527:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308096 00010000:00080000:2.0:1789583872.760553:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6752a1880 x1876514332308480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583872.760580:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583872.760589:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332308096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583872.760634:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3308:1876514332308480:0@lo:400:kworker.0 00000100:00100000:1.0:1789583872.760639:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876514332308096:12345-0@lo:400:kworker.0 Request processed in 50us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583872.760649:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789583872.760663:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583872.760674:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876514332307968:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789583872.760708:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.760751:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332308224:0@lo:8:kworker.0 00000100:00100000:1.0:1789583872.760777:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.760830:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308224 00000100:00100000:1.0:1789583872.760834:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308224 00000100:00100000:1.0:1789583872.760851:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789583872.760856:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876514332308224:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789583872.760903:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3304:x1876514332308224:12345-0@lo:8:kworker.0 Request processed in 45us (127us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789583872.760919:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789583872.760949:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789583872.760955:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789583872.760959:0:3304:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789583872.760963:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332308224:0@lo:8:kworker.0 00000100:00100000:1.0:1789583872.760991:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332308096:0@lo:400:kworker.0 00000100:00100000:0.0:1789583872.763362:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332307968 00000100:00100000:0.0:1789583872.763377:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332307968 00000100:00100000:0.0:1789583872.763430:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789583872.763444:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3304:x1876514332307968:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789583872.763482:0:14430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:0.0:1789583872.763521:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6d3e73d72c6e40da 00000004:00100000:0.0:1789583872.763536:0:14430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789583872.763583:0:14430:0:(import.c:65:import_set_state_nolock()) ffff88b67fb51800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583872.763663:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876514332307968:12345-0@lo:38:llog_process_th.0 Request processed in 218us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583872.763670:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789583872.765293:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff88b6763cb800 x1876514332307968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789583882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583872.765322:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789583872.765333:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789583872.765342:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789583872.765348:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789583872.765359:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b67baff800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789583872.765367:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3304:1876514332307968:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789583872.765552:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789583872.770781:0:15830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789583872.771639:0:15830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789583872.771664:0:15830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40c5 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583872.771679:0:15830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b641482400/0x6d3e73d72c6e40be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40c5 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789583872.772658:0:15830:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789583872.772662:0:15830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789583872.772664:0:15830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583872.772665:0:15830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583872.772672:0:15830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583872.772674:0:15830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583872.772676:0:15830:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583872.772677:0:15830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583872.772679:0:15830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583872.772683:0:15830:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789583872.772686:0:15830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789583872.772687:0:15830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789583872.772688:0:15830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583872.772689:0:15830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583872.772690:0:15830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583872.772691:0:15830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583872.772692:0:15830:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583872.772693:0:15830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583872.772694:0:15830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789583872.772720:0:15830:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789583872.772739:0:15830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332308608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789583872.772802:0:15830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583872.773339:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308608 00000100:00100000:3.0:1789583872.773347:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308608 00000100:00100000:3.0:1789583872.773391:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789583872.773399:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:15830:x1876514332308608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789583872.773423:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789583872.773435:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789583872.773633:0:15830:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b650e88900 going to sleep for 11 seconds 20000000:01000000:2.0:1789583872.811123:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789583872.811235:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789583872.812294:0:14446:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789583872.812301:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789583872.812323:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583872.812342:0:14446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583872.812351:0:14446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583872.812390:0:14446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583872.812405:0:14446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 19 pid: 14424 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583872.812436:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1876514332308736:0@lo:104: 00000100:00100000:1.0:1789583872.812506:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583872.812547:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64521b840 going to sleep for 11 seconds 00000100:00100000:2.0:1789583872.812725:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308736 00000100:00100000:2.0:1789583872.812738:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308736 00000100:00100000:2.0:1789583872.812786:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789583872.812794:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14446:x1876514332308736:12345-0@lo:104: 00010000:00010000:2.0:1789583872.812827:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.812952:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789583872.813022:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:14446:x1876514332308736:12345-0@lo:104: Request processed in 229us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.813030:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789583872.813051:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583872.813057:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813064:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:2.0:1789583872.813068:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813077:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583872.813084:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583872.813090:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789583872.813118:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813124:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789583872.813142:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813222:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfb400/0x6d3e73d72c6e3fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3fbb expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813242:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583872.813243:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583872.813245:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583872.813265:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3305:1876514332308864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789583872.813294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583872.813341:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308864 00000100:00100000:2.0:1789583872.813346:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308864 00010000:00010000:2.0:1789583872.813362:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 20 pid: 14424 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583872.813383:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789583872.813389:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+20:3305:x1876514332308864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789583872.813400:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583872.813404:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 20 pid: 14424 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813415:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 20 pid: 14424 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813429:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813437:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789583872.813449:0:14415:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001149188s 00010000:00010000:2.0:1789583872.813459:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813467:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813656:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813664:0:14415:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813670:0:14415:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583872.813674:0:14415:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813682:0:14415:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813692:0:14415:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813702:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583872.813776:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+20:3305:x1876514332308864:12345-0@lo:103:ldlm_bl.0 Request processed in 386us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583872.813783:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789583872.813848:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1800/0x6d3e73d72c6e3fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e3fb4 expref: 19 pid: 14424 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583872.813859:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14446:1876514332308736:0@lo:104: 00010000:00010000:2.0:1789583872.813885:0:14446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813900:0:14446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813907:0:14446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583872.813914:0:14446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfbc00/0x6d3e73d72c6e40e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583872.816734:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3305:1876514332308864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789583872.832087:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c502c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:15830:x1876514332308608:12345-0@lo:253:mount.lustre.0 Request processed in 58679us (59275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583872.832102:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789583872.832264:0:15830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:bec31d4c-70f2-4e81-b20d-79c0fd90522d:15830:1876514332308608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789583872.832280:0:15830:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789583872.832283:0:15830:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789583872.832285:0:15830:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789583872.832287:0:15830:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789583872.832288:0:15830:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789583872.832289:0:15830:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789583872.832291:0:15830:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789583872.832292:0:15830:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789583872.832293:0:15830:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789583872.832295:0:15830:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789583872.832308:0:15830:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789583872.850687:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583872.851295:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789583872.851459:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789583872.853280:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789583872.859667:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789583872.860163:0:15830:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789583872.864649:0:15830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789583872.913137:0:15830:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789583872.913147:0:15830:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789583872.913189:0:15830:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789583872.913241:0:15830:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.146@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789583872.913254:0:15830:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789583872.913280:0:15830:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789583873.459221:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789583874.023948:0:14427:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789583874.023956:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88b674c49000 from 8 10000000:01000000:2.0:1789583874.023962:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789583874.024011:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583874.024023:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583874.024034:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583874.024057:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332308992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789583874.024118:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583874.024170:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789583874.024467:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332308992 00000100:00100000:1.0:1789583874.024476:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332308992 00000100:00100000:1.0:1789583874.024526:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789583874.024535:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332308992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583874.024559:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583874.024575:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b652cfba00/0x6d3e73d72c6e40ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e40e8 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583874.024614:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b652cfba00/0x6d3e73d72c6e40ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40e8 expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583874.024625:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b652cfba00/0x6d3e73d72c6e40ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40e8 expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583874.024634:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b652cfba00, rc 0) 00000100:00100000:1.0:1789583874.024684:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332308992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583874.024690:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789583874.024766:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332308992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789583874.024781:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40ef expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583874.024791:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e40ef expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583874.024868:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332309120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789583874.024901:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583874.024924:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a25db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583874.024977:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309120 00000100:00100000:2.0:1789583874.024982:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309120 00000100:00100000:2.0:1789583874.025015:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789583874.025023:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332309120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789583874.025044:0:14423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789583874.025058:0:14423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789583874.025061:0:14423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789583874.025145:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332309120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583874.025153:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789583874.025183:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332309120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789583874.025233:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789583874.025242:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40ef expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583874.025249:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b6756a0000/0x6d3e73d72c6e40e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e40ef expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583874.290417:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789583874.290455:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789583874.475633:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583875.497718:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583876.142752:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583876.142775:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332309248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789583876.142876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583876.143888:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309248 00000100:00100000:1.0:1789583876.143899:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309248 00000100:00100000:1.0:1789583876.143966:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789583876.143976:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332309248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583876.144025:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583876.144089:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332309248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583876.144096:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789583876.144423:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789583876.144447:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332309248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789583876.144602:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789583876.519925:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583877.542985:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789583877.863566:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789583878.183444:0:13980:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789583878.183451:0:13980:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789583878.183456:0:13980:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789583878.183472:0:13980:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88b6444c7000 using connection 192.168.203.146@tcp/0@lo 00000100:00100000:1.0:1789583878.183495:0:13980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88b67c5f2a00 x1876514332309632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789583878.183603:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332309376:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.183667:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583878.183719:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332310016:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.183746:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583878.183772:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789583878.183779:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332309504:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.183802:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583878.183845:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332309632:0@lo:8:kworker.0 00000100:00100000:1.0:1789583878.183864:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583878.183887:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332309760:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.183907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583878.183925:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789583878.183930:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332309888:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.183952:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583878.183983:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309376 00000100:00100000:1.0:1789583878.183989:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309376 00000100:00100000:1.0:1789583878.184030:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789583878.184039:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3307:x1876514332309376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.184085:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3307:x1876514332309376:12345-0@lo:400:kworker.0 Request processed in 46us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583878.184092:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789583878.184121:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310016 00000100:00100000:1.0:1789583878.184125:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310016 00000100:00100000:1.0:1789583878.184157:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309760 00000100:00100000:1.0:1789583878.184160:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309760 00000100:00100000:1.0:1789583878.184179:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309888 00000100:00100000:1.0:1789583878.184181:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309888 00000100:00100000:1.0:1789583878.184194:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583878.184200:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332310016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.184232:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876514332310016:12345-0@lo:400:kworker.0 Request processed in 32us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583878.184238:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789583878.184249:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583878.184255:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332309760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583878.184698:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583878.184709:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332309888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583878.184754:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332309888:12345-0@lo:400:kworker.0 Request processed in 49us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583878.184760:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789583878.184786:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309504 00000100:00100000:0.0:1789583878.184792:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309504 00000100:00100000:0.0:1789583878.184837:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332309632 00000100:00100000:0.0:1789583878.184846:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332309632 00000100:00100000:0.0:1789583878.184863:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583878.184870:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332309504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583878.184907:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332309504:12345-0@lo:400:kworker.0 Request processed in 38us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583878.184912:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789583878.184924:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789583878.184928:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3304:x1876514332309632:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789583878.184950:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:0.0:1789583878.184976:0:15114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d3e73d72c6e40f6 00002000:00100000:0.0:1789583878.184989:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff88b67fb57000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789583878.184993:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789583878.184995:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789583878.186470:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332309760:12345-0@lo:400:kworker.0 Request processed in 2209us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583878.186482:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789583878.186537:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789583878.186542:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789583878.186657:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c5f1c00 x1876514332309888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583878.186673:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332309888:0@lo:400:kworker.0 00010000:00080000:1.0:1789583878.186686:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c5f1880 x1876514332309760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583878.186696:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332309760:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.186732:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332309504:0@lo:400:kworker.0 00000100:00100000:1.0:1789583878.186741:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3307:1876514332309376:0@lo:400:kworker.0 00010000:00080000:1.0:1789583878.186752:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c5f0a80 x1876514332310016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789583894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789583878.186780:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3307:1876514332310016:0@lo:400:kworker.0 00002000:00080000:0.0:1789583878.189026:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789583878.189064:0:15114:0:(import.c:65:import_set_state_nolock()) ffff88b67fb57800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583878.189147:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876514332309632:12345-0@lo:8:kworker.0 Request processed in 4216us (5280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583878.189157:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789583878.193239:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b67c5f2a00 x1876514332309632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789583903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789583878.194591:0:3304:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789583878.194605:0:3304:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789583878.194613:0:3304:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789583878.194617:0:3304:0:(import.c:65:import_set_state_nolock()) ffff88b6444c7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789583878.194634:0:3304:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789583878.194643:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3304:1876514332309632:0@lo:8:kworker.0 00000004:00080000:3.0:1789583878.195937:0:14455:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789583878.195969:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1876514332310272:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789583878.196042:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583878.196074:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b6463f5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583878.196092:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332310144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583878.196123:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583878.196164:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310144 00000100:00100000:3.0:1789583878.196171:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310144 00000100:00100000:3.0:1789583878.196222:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789583878.196231:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876514332310144:12345-0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789583878.196543:0:14454:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789583878.196980:0:14454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435181172582ns, next at 0ns, rc = 0 00002000:00000024:3.0:1789583878.198169:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583878.198256:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876514332310144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2023us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583878.199363:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789583878.199400:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583878.199676:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310272 00000100:00100000:1.0:1789583878.199685:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310272 00000100:00100000:1.0:1789583878.199727:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789583878.199737:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14455:x1876514332310272:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1789583878.201211:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88b6763e8e00 x1876514332310144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789583894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789583878.201250:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332310144:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1789583878.216687:0:15112:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789583878.216698:0:15112:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789583878.216703:0:15112:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1789583878.253173:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.253188:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253205:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.253209:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.253216:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253254:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253270:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253278:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253310:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583878.253869:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.253875:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253884:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.253887:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.253891:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253902:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253910:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253929:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253948:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789583878.253962:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789583878.253967:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253974:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.253979:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.253988:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254006:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254014:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e40fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254031:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.254034:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254051:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.254054:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254061:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254071:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254077:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4104 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254089:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.254091:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.254093:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.254492:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.254499:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254507:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.254510:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.254527:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254538:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254554:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254562:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254577:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.254587:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.254591:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254597:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.254600:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254608:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254620:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254627:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e410b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.254640:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.254648:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.254649:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.255108:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.255115:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255124:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.255127:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.255131:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255142:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255149:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255155:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255168:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.255177:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.255180:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255186:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfac00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.255189:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255208:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255219:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255226:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000657e4d0d/0x6d3e73d72c6e4112 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.255240:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.255242:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.255243:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.261649:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.264967:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.264982:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.265000:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.265005:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.265012:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.265027:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.265038:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.265053:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.265072:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.265086:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.265092:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.265100:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfa000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.265104:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.270438:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.270467:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.270476:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb6f7699/0x6d3e73d72c6e4119 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.270501:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.270504:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.270507:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.272931:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.272953:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.272969:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.272974:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.272980:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.272995:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273007:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273014:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273031:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583878.273492:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.273499:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273508:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.273511:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.273524:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273534:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273549:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273555:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273570:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789583878.273584:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789583878.273589:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273597:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbc00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.273602:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273609:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273625:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273632:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0c9e245/0x6d3e73d72c6e4120 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273648:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.273657:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273663:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.273667:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273674:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273686:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273692:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dee6823/0x6d3e73d72c6e4127 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.273704:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.273706:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.273708:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.274091:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.274097:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274107:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.274110:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.274115:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274135:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274143:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274152:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274165:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.274172:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.274176:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274182:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfb200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.274186:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274193:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274204:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274212:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2edde64/0x6d3e73d72c6e412e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274229:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.274231:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.274233:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.274605:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.274611:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274620:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.274623:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.274627:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274637:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274646:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274653:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274665:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.274673:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.274676:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274692:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.274695:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274704:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274714:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274721:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4135 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.274734:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.274736:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.274737:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.275088:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.275094:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275104:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.275107:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.275111:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275120:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275134:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275141:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275153:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.275160:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.275163:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275170:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507800 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.275173:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275181:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275191:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275198:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e413c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.275210:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.275215:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.275217:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.275972:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789583878.276648:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789583878.284679:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.284693:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284710:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.284715:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.284721:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284736:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284746:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284754:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284771:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.284781:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.284786:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284793:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506a00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.284798:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284835:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284852:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284858:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005757d794/0x6d3e73d72c6e4143 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.284874:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.284875:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.284877:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.291846:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.291857:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.291875:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.291880:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.291886:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.291901:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.291910:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.291927:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.291946:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583878.292511:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.292534:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292544:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.292547:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.292551:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292560:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292568:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292575:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292590:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789583878.292600:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789583878.292606:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292619:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.292623:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292633:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292649:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292657:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e414a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292675:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.292679:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292685:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.292688:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292694:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292703:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292714:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e4151 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.292726:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.292728:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.292730:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.293131:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.293137:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293145:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.293148:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.293152:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293160:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293168:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293174:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293187:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.293195:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.293204:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293211:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.293214:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293222:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293233:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293239:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e4158 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293252:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.293254:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.293255:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.293639:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.293645:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293653:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.293655:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.293659:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293679:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293686:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293693:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293706:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.293714:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.293717:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293724:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.293727:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293734:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293743:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293750:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e415f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.293767:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.293769:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.293770:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.294211:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.294217:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294226:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.294229:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.294234:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294243:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294251:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294257:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294271:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.294279:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.294282:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294299:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.294302:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294309:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294319:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294325:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e4166 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.294337:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.294338:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.294339:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.296113:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.305070:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.305085:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305103:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.305107:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.305127:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305144:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305164:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305172:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305191:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789583878.305205:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.305211:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305219:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.305223:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305233:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305249:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305257:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f7285b7/0x6d3e73d72c6e416d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.305670:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.305678:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.305680:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.306583:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.306592:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.306607:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.306610:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.306615:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.306625:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.306632:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.306639:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.306656:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583878.307084:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.307090:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307100:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.307103:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.307107:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307131:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307140:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307147:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307161:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789583878.307172:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789583878.307177:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307185:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.307190:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307198:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307212:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307219:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000259c3001/0x6d3e73d72c6e4174 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307241:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789583878.307245:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.307252:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507800 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:1.0:1789583878.307255:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.308839:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.308862:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.308870:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e445ee7d/0x6d3e73d72c6e417b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.308896:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.308898:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.308901:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.310293:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.311588:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.311599:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.311617:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.311622:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.311636:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.311651:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.311667:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.311674:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.311698:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583878.312248:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583878.312257:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.312278:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583878.312283:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.312293:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.312321:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.312329:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017c777f5/0x6d3e73d72c6e4182 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.312352:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.312353:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.312355:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.312635:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.312642:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.312652:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.312656:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.312662:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.312715:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.312724:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.312743:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.312774:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583878.313232:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.313238:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.313247:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.313251:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.313255:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.313650:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583878.313658:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.313666:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583878.313670:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.313691:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.313705:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.313712:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a32585fe/0x6d3e73d72c6e4189 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.313729:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.313730:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.313732:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583878.313767:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.313776:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.313784:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.315204:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789583878.315414:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583878.315422:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.315434:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583878.315439:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.315448:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.315467:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.315488:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bce9202/0x6d3e73d72c6e4190 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583878.315522:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.315524:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583878.315526:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.318679:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.318692:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.318714:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.318719:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.318725:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.318740:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.318751:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.318758:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.318783:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789583878.319429:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583878.319437:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.319448:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583878.319452:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.319462:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.319489:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.319497:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006539222b/0x6d3e73d72c6e4197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.319530:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583878.319532:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583878.319534:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789583878.323727:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.323739:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.323756:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.323761:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.323767:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.323782:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.323833:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.323843:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.323865:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789583878.324300:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.324306:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324315:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.324318:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.324322:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324331:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324339:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324346:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324380:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789583878.324784:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.324790:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324799:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.324802:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.324831:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324841:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324850:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324857:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.324866:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789583878.325220:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.325226:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325234:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.325243:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.325247:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325257:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325265:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325271:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325279:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789583878.325670:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789583878.325676:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325685:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789583878.325688:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583878.325692:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325702:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325708:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325722:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583878.325729:0:15112:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1789583878.326294:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789583878.326303:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326312:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583878.326317:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326326:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326343:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326350:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c284cd8/0x6d3e73d72c6e419e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326384:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789583878.326388:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326394:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583878.326397:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326404:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326415:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326422:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057ea2d37/0x6d3e73d72c6e41a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326435:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789583878.326438:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326444:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583878.326448:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326467:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326476:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326484:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d71594/0x6d3e73d72c6e41ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326499:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789583878.326502:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326508:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583878.326511:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326529:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326539:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326546:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000788bc71a/0x6d3e73d72c6e41b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326572:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789583878.326576:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326582:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506400 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583878.326585:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326594:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326603:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326609:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060165942/0x6d3e73d72c6e41ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583878.326621:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583878.326623:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583878.326624:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583878.329939:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789583878.334307:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1789583878.338441:0:15112:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1789583878.338555:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14455:x1876514332310272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 138815us (142508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583878.338566:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583878.339735:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1876514332310272:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789583878.339753:0:14455:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789583878.339798:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1876514332310400:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789583878.339876:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583878.339925:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b643174d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789583878.340581:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310400 00000100:00100000:0.0:1789583878.340589:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310400 00000100:00100000:0.0:1789583878.340673:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789583878.340685:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14455:x1876514332310400:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789583878.340731:0:15115:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789583878.356899:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14455:x1876514332310400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16206us (17012us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789583878.356913:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789583878.358292:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14455:1876514332310400:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789583878.358310:0:14455:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1789583878.576706:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583879.598285:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789583880.105883:0:16187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg346-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789583880.620214:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583881.257616:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332310528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583881.257686:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583881.262584:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310528 00000100:00100000:3.0:1789583881.262597:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310528 00000100:00100000:3.0:1789583881.262669:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583881.262680:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332310528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583881.262718:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583881.262801:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332310528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (5115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583881.262836:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789583881.262891:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332310528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789583881.263239:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789583881.644001:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583882.403354:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.403517:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444224 00000100:00100000:1.0:1789583882.403527:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444224 00000100:00100000:1.0:1789583882.403584:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:1.0:1789583882.403592:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1876514313444224:12345-192.168.203.46@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789583882.403619:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f0cad7b4-080c-4110-a88b-60d42f235bfe@192.168.203.46@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:1.0:1789583882.403660:0:14424:0:(genops.c:1384:class_connect()) connect: client f0cad7b4-080c-4110-a88b-60d42f235bfe, cookie 0x6d3e73d72c6e41c1 00000100:00080000:1.0:1789583882.404043:0:14424:0:(import.c:65:import_set_state_nolock()) ffff88b64a6cd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789583882.404118:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+5:2357:x1876514313444224:12345-192.168.203.46@tcp:250:mount.lustre.0 Request processed in 524us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.404341:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 76 00000100:00100000:1.0:1789583882.408242:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.411941:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444352 00000100:00100000:0.0:1789583882.411956:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444352 00000100:00100000:0.0:1789583882.412027:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:0.0:1789583882.412036:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+5:13749:x1876514313444352:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789583882.412052:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583882.412073:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b66df54800/0x6d3e73d72c6e41c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6785 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583882.412115:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df54800/0x6d3e73d72c6e41c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6785 expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583882.412133:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b66df54800/0x6d3e73d72c6e41c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6785 expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583882.412143:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54800, rc 0) 00000100:00100000:0.0:1789583882.412214:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+6:13749:x1876514313444352:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 178us (3982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.412220:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 77 00000100:00100000:2.0:1789583882.418326:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.418435:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444480 00000100:00100000:1.0:1789583882.418445:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444480 00000100:00100000:1.0:1789583882.418507:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:1.0:1789583882.418517:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+6:13749:x1876514313444480:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789583882.418910:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+6:13749:x1876514313444480:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 394us (592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789583882.418918:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 78 00000100:00100000:3.0:1789583882.423182:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583882.423307:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444608 00000100:00100000:2.0:1789583882.423318:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444608 00000100:00100000:2.0:1789583882.423373:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:2.0:1789583882.423384:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+6:13749:x1876514313444608:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789583882.423401:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583882.423419:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a0e00/0x6d3e73d72c6e41cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec678c expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.423447:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a0e00/0x6d3e73d72c6e41cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec678c expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.423457:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a0e00/0x6d3e73d72c6e41cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec678c expref: 7 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.423465:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0e00, rc 0) 00000100:00100000:2.0:1789583882.423538:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+7:13749:x1876514313444608:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 156us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583882.423544:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 79 00000100:00100000:2.0:1789583882.427364:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.428089:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444736 00000100:00100000:0.0:1789583882.428099:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444736 00000100:00100000:0.0:1789583882.428244:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:0.0:1789583882.428254:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+7:13749:x1876514313444736:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789583882.428609:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13749:x1876514313444736:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 356us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.428622:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 80 00000100:00100000:3.0:1789583882.430867:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.431376:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444864 00000100:00100000:1.0:1789583882.431386:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444864 00000100:00100000:1.0:1789583882.431443:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:1.0:1789583882.431454:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13749:x1876514313444864:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789583882.431851:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13749:x1876514313444864:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 397us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.431860:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 81 00000100:00100000:3.0:1789583882.436764:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583882.437301:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313444992 00000100:00100000:2.0:1789583882.437312:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313444992 00000100:00100000:2.0:1789583882.437366:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:2.0:1789583882.437376:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13767:x1876514313444992:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789583882.437737:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13767:x1876514313444992:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 361us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583882.437746:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 82 00000100:00100000:2.0:1789583882.453924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.454200:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445120 00000100:00100000:1.0:1789583882.454211:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445120 00000100:00100000:1.0:1789583882.454264:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:1.0:1789583882.454273:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13767:x1876514313445120:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583882.454563:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13767:x1876514313445120:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 291us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.454572:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 83 00000100:00100000:3.0:1789583882.463449:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.463590:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445248 00000100:00100000:0.0:1789583882.463601:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445248 00000100:00100000:0.0:1789583882.463659:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:0.0:1789583882.463669:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+8:13749:x1876514313445248:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789583882.463687:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583882.463704:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b66df54600/0x6d3e73d72c6e41d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec67b6 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583882.463731:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b66df54600/0x6d3e73d72c6e41d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67b6 expref: 9 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583882.463741:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b66df54600/0x6d3e73d72c6e41d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67b6 expref: 9 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583882.463750:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54600, rc 0) 00000100:00100000:0.0:1789583882.463834:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+9:13749:x1876514313445248:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.463841:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 84 00000100:00100000:3.0:1789583882.470714:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583882.470844:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445376 00000100:00100000:2.0:1789583882.470854:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445376 00000100:00100000:2.0:1789583882.470898:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:2.0:1789583882.470907:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+9:13749:x1876514313445376:12345-192.168.203.46@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789583882.470930:0:14423:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789583882.470962:0:14423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789583882.470966:0:14423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789583882.470969:0:14423:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789583882.470972:0:14423:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789583882.484040:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+9:13749:x1876514313445376:12345-192.168.203.46@tcp:256:mount.lustre.0 Request processed in 13123us (13323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.484055:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 85 00000100:00100000:3.0:1789583882.490601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.490845:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445504 00000100:00100000:1.0:1789583882.490869:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445504 00000100:00100000:1.0:1789583882.490926:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:1.0:1789583882.490936:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67bac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+9:13749:x1876514313445504:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789583882.490961:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583882.490982:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec67bd expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583882.491012:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583882.491023:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 10 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583882.491032:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542506e00, rc 0) 00000100:00100000:1.0:1789583882.491098:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67bac4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13749:x1876514313445504:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 164us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.491105:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 86 00000100:00100000:3.0:1789583882.493142:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.493303:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445632 00000100:00100000:1.0:1789583882.493311:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445632 00000100:00100000:1.0:1789583882.493357:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:1.0:1789583882.493366:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13749:x1876514313445632:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789583882.493648:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661907050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13749:x1876514313445632:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 282us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.493656:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 87 00000100:00100000:2.0:1789583882.495462:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.495544:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445760 00000100:00100000:0.0:1789583882.495552:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445760 00000100:00100000:0.0:1789583882.495598:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:0.0:1789583882.495606:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13749:x1876514313445760:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789583882.495989:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661904850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13749:x1876514313445760:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 382us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.495997:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 88 00000100:00100000:2.0:1789583882.509202:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583882.509563:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313445888 00000100:00100000:3.0:1789583882.509573:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313445888 00000100:00100000:3.0:1789583882.509629:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:3.0:1789583882.509639:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13771:x1876514313445888:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789583882.510627:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661907c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13771:x1876514313445888:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 983us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583882.510638:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 89 00000100:00100000:3.0:1789583882.515353:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.515597:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446016 00000100:00100000:1.0:1789583882.515608:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446016 00000100:00100000:1.0:1789583882.515661:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 90 00000100:00100000:1.0:1789583882.515671:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13771:x1876514313446016:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583882.516529:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661906450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13771:x1876514313446016:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 853us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583882.516540:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 90 00000100:00100000:2.0:1789583882.540540:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.540742:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446144 00000100:00100000:0.0:1789583882.540753:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446144 00000100:00100000:0.0:1789583882.540801:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:0.0:1789583882.540845:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1876514313446144:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789583882.540873:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ed077288-dbc1-4a86-bd3d-7e15f0b68daf@192.168.203.46@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1789583882.540921:0:14432:0:(genops.c:1384:class_connect()) connect: client ed077288-dbc1-4a86-bd3d-7e15f0b68daf, cookie 0x6d3e73d72c6e41e4 00000004:00100000:0.0:1789583882.540957:0:14432:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789583882.540964:0:14432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789583882.601900:0:14432:0:(import.c:65:import_set_state_nolock()) ffff88b541bfc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789583882.602086:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2357:x1876514313446144:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 61231us (61546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583882.602097:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:0.0:1789583882.617573:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.617663:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583882.620685:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446272 00000100:00100000:2.0:1789583882.620700:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446272 00000100:00100000:0.0:1789583882.622357:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446400 00000100:00100000:0.0:1789583882.622370:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446400 00000100:00100000:0.0:1789583882.622411:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583882.622429:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:0:x1876514313446272:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789583882.622479:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789583882.622587:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:0:x1876514313446272:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 161us (5023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.622595:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583882.622615:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:0.0:1789583882.622622:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13749:x1876514313446400:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789583882.622634:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789583882.622657:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13749:x1876514313446400:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 35us (4994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.622663:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00080000:0.0:1789583882.622683:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583882.629571:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583882.633320:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446528 00000100:00100000:0.0:1789583882.633333:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446528 00000100:00100000:0.0:1789583882.633403:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789583882.633479:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13749:x1876514313446528:12345-192.168.203.46@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789583882.633592:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13749:x1876514313446528:12345-192.168.203.46@tcp:40:mount.lustre.0 Request processed in 170us (4022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583882.633600:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789583882.640262:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.640416:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446912 00000100:00100000:1.0:1789583882.640430:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446912 00000100:00100000:1.0:1789583882.640506:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:1.0:1789583882.640519:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13749:x1876514313446912:12345-192.168.203.46@tcp:33:mount.lustre.0 00000100:00100000:1.0:1789583882.654211:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583882.654247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583882.654768:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446656 00000100:00100000:3.0:1789583882.654787:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446656 00000100:00100000:3.0:1789583882.654886:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313446784 00000100:00100000:3.0:1789583882.654890:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313446784 00000100:00100000:3.0:1789583882.654912:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789583882.654923:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876514313446656:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789583882.654967:0:15112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ed077288-dbc1-4a86-bd3d-7e15f0b68daf@192.168.203.46@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1789583882.655009:0:15112:0:(genops.c:1384:class_connect()) connect: client ed077288-dbc1-4a86-bd3d-7e15f0b68daf, cookie 0x6d3e73d72c6e41eb 00002000:00100000:3.0:1789583882.655024:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ed077288-dbc1-4a86-bd3d-7e15f0b68daf/ffff88b541bff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789583882.655055:0:15112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789583882.655511:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789583882.655556:0:15112:0:(import.c:65:import_set_state_nolock()) ffff88b541bfb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789583882.655652:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2357:x1876514313446656:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 729us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583882.655661:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789583882.655687:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:3.0:1789583882.655693:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1876514313446784:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789583882.655714:0:15112:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ed077288-dbc1-4a86-bd3d-7e15f0b68daf@192.168.203.46@tcp t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1789583882.655734:0:15112:0:(genops.c:1384:class_connect()) connect: client ed077288-dbc1-4a86-bd3d-7e15f0b68daf, cookie 0x6d3e73d72c6e41f2 00002000:00100000:3.0:1789583882.655741:0:15112:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ed077288-dbc1-4a86-bd3d-7e15f0b68daf/ffff88b666640000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789583882.655761:0:15112:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789583882.655931:0:15112:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789583882.655948:0:15112:0:(import.c:65:import_set_state_nolock()) ffff88b666640800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789583882.655974:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2357:x1876514313446784:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 279us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583882.655981:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000004:00080000:2.0:1789583882.656296:0:14433:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15686us 00000004:00200000:3.0:1789583882.662354:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789583882.662474:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13749:x1876514313446912:12345-192.168.203.46@tcp:33:mount.lustre.0 Request processed in 21952us (22223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583882.662500:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00010000:00010000:2.0:1789583882.664783:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583882.878377:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583882.878515:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447040 00000100:00100000:2.0:1789583882.878540:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447040 00000100:00100000:2.0:1789583882.878602:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:2.0:1789583882.878620:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:13791:x1876514313447040:12345-192.168.203.46@tcp:101:mkdir.0 00010000:00010000:2.0:1789583882.878640:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583882.878663:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e41f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec67e7 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.878726:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e4200 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.878739:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e4200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.878755:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e4200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583882.878789:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789583882.878793:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583882.878870:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e4200 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.878897:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e41f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67e7 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.878915:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e4200 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67e7 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583882.878923:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583882.878926:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583882.878929:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1000, rc 0) 00000100:00100000:2.0:1789583882.878998:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:13791:x1876514313447040:12345-192.168.203.46@tcp:101:mkdir.0 Request processed in 387us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583882.879005:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:0.0:1789583883.303725:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583883.303795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583883.308613:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310656 00000100:00100000:0.0:1789583883.308623:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310656 00000100:00100000:3.0:1789583883.308674:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332310912:0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.308675:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583883.308683:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332310656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583883.308703:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583883.308734:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583883.308742:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876514332310656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583883.308748:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789583883.308760:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:0.0:1789583883.308767:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583883.308778:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332310784:0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.308783:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332311040:0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.311060:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583883.311405:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789583883.311650:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332311168:0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.311702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583883.313281:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311040 00000100:00100000:1.0:1789583883.313293:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311040 00000100:00100000:1.0:1789583883.313470:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311168 00000100:00100000:1.0:1789583883.313475:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311168 00000100:00100000:1.0:1789583883.313520:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789583883.313530:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332311040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583883.313616:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332311040:12345-0@lo:400:kworker.0 Request processed in 87us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583883.313623:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789583883.313639:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789583883.313646:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332311168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583883.314156:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583883.314528:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332311168:12345-0@lo:400:kworker.0 Request processed in 881us (2824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583883.314535:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789583883.314559:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789583883.314597:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332311168:0@lo:400:kworker.0 00000100:00100000:1.0:1789583883.314626:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332311040:0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.319836:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332310656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583883.319876:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310912 00000100:00100000:0.0:1789583883.319882:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310912 00000100:00100000:0.0:1789583883.319941:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789583883.319950:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332310912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.320023:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332310912:12345-0@lo:400:kworker.0 Request processed in 74us (11288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583883.320030:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789583883.320568:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332310784 00000100:00100000:2.0:1789583883.320573:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332310784 00000100:00100000:2.0:1789583883.320599:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789583883.320605:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b661907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3308:x1876514332310784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583883.320644:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b661907450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3308:x1876514332310784:12345-0@lo:400:kworker.0 Request processed in 39us (6489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583883.320650:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789583883.320913:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583883.328535:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332310784:0@lo:400:kworker.0 00000100:00100000:2.0:1789583883.328560:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332311296:0@lo:400:kworker.0 00000100:00100000:2.0:1789583883.328687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583883.328734:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332310912:0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.328948:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311296 00000100:00100000:0.0:1789583883.328957:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311296 00000100:00100000:0.0:1789583883.329014:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789583883.329024:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332311296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583883.329282:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332311296:12345-0@lo:400:kworker.0 Request processed in 259us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583883.329290:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789583883.329320:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583883.329399:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332311296:0@lo:400:kworker.0 00000001:00080000:0.0:1789583883.364382:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789583883.364666:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ed077288-dbc1-4a86-bd3d-7e15f0b68daf 00010000:00010000:3.0:1789583883.687860:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789583884.380220:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ed077288-dbc1-4a86-bd3d-7e15f0b68daf 00010000:00010000:2.0:1789583884.714346:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583884.928724:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583884.930916:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447168 00000100:00100000:2.0:1789583884.930932:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447168 00000100:00100000:2.0:1789583884.931208:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789583884.931220:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:13844:x1876514313447168:12345-192.168.203.46@tcp:41:lfs.0 00000004:00000024:2.0:1789583884.931265:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789583884.931374:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:13844:x1876514313447168:12345-192.168.203.46@tcp:41:lfs.0 Request processed in 156us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583884.931382:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00080000:0.0:1789583884.931727:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583884.934605:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583884.934742:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447296 00000100:00100000:0.0:1789583884.934759:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447296 00000100:00100000:0.0:1789583884.935184:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583884.935194:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:13844:x1876514313447296:12345-192.168.203.46@tcp:13:lfs.0 00002000:00000024:0.0:1789583884.935231:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583884.935316:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:13844:x1876514313447296:12345-192.168.203.46@tcp:13:lfs.0 Request processed in 124us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583884.935323:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00080000:1.0:1789583884.936286:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583884.938937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583884.939594:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447424 00000100:00100000:0.0:1789583884.939606:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447424 00000100:00100000:0.0:1789583884.939690:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:0.0:1789583884.939700:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:13844:x1876514313447424:12345-192.168.203.46@tcp:13:lfs.0 00002000:00000024:0.0:1789583884.939737:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583884.939871:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:13844:x1876514313447424:12345-192.168.203.46@tcp:13:lfs.0 Request processed in 172us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583884.939879:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00080000:1.0:1789583884.940398:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789583885.114274:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.114521:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447552 00000100:00100000:1.0:1789583885.114532:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447552 00000100:00100000:1.0:1789583885.114650:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:1.0:1789583885.114661:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+10:13876:x1876514313447552:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789583885.114678:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583885.114694:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b542506000/0x6d3e73d72c6e4207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec67ee expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583885.114721:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b542506000/0x6d3e73d72c6e4207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67ee expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583885.114733:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b542506000/0x6d3e73d72c6e4207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67ee expref: 11 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583885.114742:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542506000, rc 0) 00000100:00100000:1.0:1789583885.114832:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13876:x1876514313447552:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 173us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.114840:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 92 00000100:00100000:2.0:1789583885.119566:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.126989:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447680 00000100:00100000:0.0:1789583885.127005:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447680 00000100:00100000:0.0:1789583885.127065:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:0.0:1789583885.127074:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13876:x1876514313447680:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789583885.129267:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13876:x1876514313447680:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 2183us (9699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.129282:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 93 00000100:00100000:2.0:1789583885.137699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.141761:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447808 00000100:00100000:1.0:1789583885.141785:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447808 00000100:00100000:1.0:1789583885.141886:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:1.0:1789583885.141899:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13876:x1876514313447808:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789583885.142864:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13876:x1876514313447808:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 962us (5174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.142877:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 94 00000100:00100000:2.0:1789583885.159489:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583885.159872:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313447936 00000100:00100000:3.0:1789583885.159887:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313447936 00000100:00100000:3.0:1789583885.160002:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 95 00000100:00100000:3.0:1789583885.160014:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13883:x1876514313447936:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789583885.160493:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13883:x1876514313447936:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 479us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583885.160514:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 95 00000100:00100000:2.0:1789583885.177150:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.177276:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448064 00000100:00100000:1.0:1789583885.177293:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448064 00000100:00100000:1.0:1789583885.177370:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:1.0:1789583885.177382:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13883:x1876514313448064:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583885.177785:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13883:x1876514313448064:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 394us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.177795:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 96 00000100:00100000:2.0:1789583885.184135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583885.184479:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448192 00000100:00100000:3.0:1789583885.184494:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448192 00000100:00100000:3.0:1789583885.184587:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:3.0:1789583885.184600:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13876:x1876514313448192:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789583885.184625:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583885.184650:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f600/0x6d3e73d72c6e420e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6818 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583885.184689:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f600/0x6d3e73d72c6e420e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6818 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583885.184703:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f600/0x6d3e73d72c6e420e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6818 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583885.184715:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f600, rc 0) 00000100:00100000:3.0:1789583885.184828:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13876:x1876514313448192:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 207us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583885.184855:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 97 00000100:00100000:2.0:1789583885.191377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.191639:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448320 00000100:00100000:0.0:1789583885.191653:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448320 00000100:00100000:0.0:1789583885.191720:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:0.0:1789583885.191733:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13876:x1876514313448320:12345-192.168.203.46@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789583885.191768:0:14425:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789583885.191855:0:14425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789583885.191860:0:14425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789583885.191864:0:14425:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789583885.191867:0:14425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789583885.202741:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13876:x1876514313448320:12345-192.168.203.46@tcp:256:mount.lustre.0 Request processed in 10992us (11364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.202761:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 98 00000100:00100000:2.0:1789583885.206699:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.207133:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448448 00000100:00100000:1.0:1789583885.207148:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448448 00000100:00100000:1.0:1789583885.207260:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:1.0:1789583885.207273:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13876:x1876514313448448:12345-192.168.203.46@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789583885.207296:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583885.207320:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec681f expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583885.207357:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583885.207371:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583885.207381:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507800, rc 0) 00000100:00100000:1.0:1789583885.207480:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13876:x1876514313448448:12345-192.168.203.46@tcp:101:mount.lustre.0 Request processed in 209us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.207506:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 99 00000100:00100000:2.0:1789583885.209652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.209759:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448576 00000100:00100000:0.0:1789583885.209798:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448576 00000100:00100000:0.0:1789583885.209883:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:0.0:1789583885.209893:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b64333dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13876:x1876514313448576:12345-192.168.203.46@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789583885.210254:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b64333dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13876:x1876514313448576:12345-192.168.203.46@tcp:501:mount.lustre.0 Request processed in 361us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.210263:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 100 00000100:00100000:2.0:1789583885.212349:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.212705:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448704 00000100:00100000:0.0:1789583885.212717:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448704 00000100:00100000:0.0:1789583885.212918:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:0.0:1789583885.212928:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b68207a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13876:x1876514313448704:12345-192.168.203.46@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789583885.213425:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b68207a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13876:x1876514313448704:12345-192.168.203.46@tcp:503:mount.lustre.0 Request processed in 487us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.213435:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 101 00000100:00100000:2.0:1789583885.223202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583885.223792:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448832 00000100:00100000:3.0:1789583885.223854:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448832 00000100:00100000:3.0:1789583885.223918:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:3.0:1789583885.223930:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b682078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13888:x1876514313448832:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789583885.224286:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b682078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13888:x1876514313448832:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 357us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583885.224295:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 102 00000100:00100000:2.0:1789583885.229096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.229661:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313448960 00000100:00100000:1.0:1789583885.229676:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313448960 00000100:00100000:1.0:1789583885.229751:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:1.0:1789583885.229763:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b68207b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13888:x1876514313448960:12345-192.168.203.46@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789583885.230262:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b68207b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13888:x1876514313448960:12345-192.168.203.46@tcp:502:llog_process_th.0 Request processed in 499us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.230272:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 103 00000100:00100000:1.0:1789583885.242227:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.242470:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449088 00000100:00100000:0.0:1789583885.242485:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449088 00000100:00100000:0.0:1789583885.242558:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583885.242568:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1876514313449088:12345-192.168.203.46@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789583885.242606:0:14431:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0362f4f7-c01c-41c4-8e43-92ded75317bc@192.168.203.46@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1789583885.242664:0:14431:0:(genops.c:1384:class_connect()) connect: client 0362f4f7-c01c-41c4-8e43-92ded75317bc, cookie 0x6d3e73d72c6e421c 00000004:00100000:0.0:1789583885.242707:0:14431:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789583885.243198:0:14431:0:(import.c:65:import_set_state_nolock()) ffff88b541c4c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583885.243504:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:2357:x1876514313449088:12345-192.168.203.46@tcp:38:mount.lustre.0 Request processed in 934us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.243515:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789583885.253555:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583885.253602:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.253756:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449216 00000100:00100000:1.0:1789583885.253769:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449216 00000100:00100000:1.0:1789583885.253894:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449344 00000100:00100000:1.0:1789583885.253898:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449344 00000100:00100000:1.0:1789583885.253920:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:1.0:1789583885.253930:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+7:0:x1876514313449216:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789583885.253988:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789583885.254086:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+7:0:x1876514313449216:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 157us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.254095:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:1.0:1789583885.254114:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:1.0:1789583885.254120:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13876:x1876514313449344:12345-192.168.203.46@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789583885.254132:0:14430:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789583885.254151:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13876:x1876514313449344:12345-192.168.203.46@tcp:41:mount.lustre.0 Request processed in 32us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.254176:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00080000:0.0:1789583885.255017:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789583885.256420:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583885.256649:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449472 00000100:00100000:1.0:1789583885.256661:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449472 00000100:00100000:1.0:1789583885.256761:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:1.0:1789583885.256780:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13876:x1876514313449472:12345-192.168.203.46@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789583885.256917:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13876:x1876514313449472:12345-192.168.203.46@tcp:40:mount.lustre.0 Request processed in 146us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583885.256925:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789583885.259546:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583885.259591:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583885.259630:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.259766:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449600 00000100:00100000:0.0:1789583885.259787:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449600 00000100:00100000:0.0:1789583885.259859:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449728 00000100:00100000:0.0:1789583885.259863:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449728 00000100:00100000:0.0:1789583885.259878:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583885.259889:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1876514313449600:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789583885.259926:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0362f4f7-c01c-41c4-8e43-92ded75317bc@192.168.203.46@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1789583885.259968:0:15114:0:(genops.c:1384:class_connect()) connect: client 0362f4f7-c01c-41c4-8e43-92ded75317bc, cookie 0x6d3e73d72c6e4223 00002000:00100000:0.0:1789583885.259983:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0362f4f7-c01c-41c4-8e43-92ded75317bc/ffff88b651209800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789583885.259998:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789583885.260306:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789583885.260353:0:15114:0:(import.c:65:import_set_state_nolock()) ffff88b65120f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583885.260442:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:2357:x1876514313449600:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 552us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.260451:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583885.260489:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789583885.260496:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1876514313449728:12345-192.168.203.46@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789583885.260515:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0362f4f7-c01c-41c4-8e43-92ded75317bc@192.168.203.46@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1789583885.260565:0:15114:0:(genops.c:1384:class_connect()) connect: client 0362f4f7-c01c-41c4-8e43-92ded75317bc, cookie 0x6d3e73d72c6e422a 00002000:00100000:0.0:1789583885.260573:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0362f4f7-c01c-41c4-8e43-92ded75317bc/ffff88b64a115800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789583885.260581:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789583885.260736:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789583885.260752:0:15114:0:(import.c:65:import_set_state_nolock()) ffff88b64a112800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789583885.260794:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:2357:x1876514313449728:12345-192.168.203.46@tcp:8:mount.lustre.0 Request processed in 297us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.260829:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789583885.261705:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449856 00000100:00100000:3.0:1789583885.261717:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449856 00000100:00100000:3.0:1789583885.262090:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:3.0:1789583885.262102:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13876:x1876514313449856:12345-192.168.203.46@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789583885.262187:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789583885.262273:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13876:x1876514313449856:12345-192.168.203.46@tcp:33:mount.lustre.0 Request processed in 173us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583885.262281:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:1.0:1789583885.470259:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583885.473632:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313449984 00000100:00100000:0.0:1789583885.474000:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313449984 00000100:00100000:0.0:1789583885.474113:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:0.0:1789583885.474127:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:13909:x1876514313449984:12345-192.168.203.46@tcp:101:mkdir.0 00010000:00010000:0.0:1789583885.474156:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789583885.474189:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55e00/0x6d3e73d72c6e4231 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6849 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583885.474273:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583885.474291:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583885.474308:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583885.474354:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789583885.474358:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583885.474408:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583885.474440:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55e00/0x6d3e73d72c6e4231 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583885.474473:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583885.474519:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:0.0:1789583885.474522:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789583885.474526:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54200, rc 0) 00000100:00100000:0.0:1789583885.474623:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+7:13909:x1876514313449984:12345-192.168.203.46@tcp:101:mkdir.0 Request processed in 499us (4378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583885.474631:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00010000:00010000:3.0:1789583885.736617:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789583886.375037:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332311424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789583886.375148:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583886.375277:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311424 00000100:00100000:1.0:1789583886.375288:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311424 00000100:00100000:1.0:1789583886.375372:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789583886.375385:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332311424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789583886.375434:0:15117:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789583886.379469:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332311424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4066us (4300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583886.379489:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789583886.379536:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583886.379998:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332311424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789583886.761060:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789583887.079525:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789583887.785785:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789583887.973278:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0362f4f7-c01c-41c4-8e43-92ded75317bc 00000001:00100000:2.0:1789583887.973294:0:5871:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ed077288-dbc1-4a86-bd3d-7e15f0b68daf 00000001:02000400:0.0:1789583888.218351:0:16390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789583888.432596:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583888.432619:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332311552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583888.432683:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583888.432753:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311552 00000100:00100000:0.0:1789583888.432761:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311552 00000100:00100000:0.0:1789583888.432828:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789583888.432838:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332311552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789583888.432871:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789583888.432915:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876514332311552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583888.432922:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789583888.432957:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789583888.432978:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332311552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583888.434075:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332311680:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434121:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583888.434172:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311680 00000100:00100000:0.0:1789583888.434178:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311680 00000100:00100000:0.0:1789583888.434211:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789583888.434218:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b682079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3306:x1876514332311680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434255:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b682079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3306:x1876514332311680:12345-0@lo:400:kworker.0 Request processed in 37us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583888.434262:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789583888.434297:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332311680:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434342:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789583888.434349:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332311808:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583888.434417:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332311936:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583888.434485:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311936 00000100:00100000:0.0:1789583888.434489:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311936 00000100:00100000:0.0:1789583888.434518:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583888.434525:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332311936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434560:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876514332311936:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583888.434566:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789583888.434592:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876514332311936:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434620:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583888.434627:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332312064:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434660:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583888.434682:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332312064 00000100:00100000:0.0:1789583888.434685:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332312064 00000100:00100000:0.0:1789583888.434721:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789583888.434728:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332312064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434761:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332312064:12345-0@lo:400:kworker.0 Request processed in 33us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583888.434766:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789583888.434790:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332312064:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434840:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332312192:0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434867:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583888.434889:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332312192 00000100:00100000:0.0:1789583888.434893:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332312192 00000100:00100000:0.0:1789583888.434916:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789583888.434922:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332312192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583888.434953:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876514332312192:12345-0@lo:400:kworker.0 Request processed in 31us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583888.434959:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789583888.434983:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3306:1876514332312192:0@lo:400:kworker.0 00000100:00080000:1.0:1789583888.435100:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583888.435105:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789583888.435573:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332311808 00000100:00100000:1.0:1789583888.435579:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332311808 00000100:00100000:1.0:1789583888.435621:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789583888.435629:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332311808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789583888.435677:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332311808:12345-0@lo:400:kworker.0 Request processed in 49us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583888.435692:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789583888.435721:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583888.435744:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332311808:0@lo:400:kworker.0 00000001:00100000:1.0:1789583888.486352:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0362f4f7-c01c-41c4-8e43-92ded75317bc 00010000:00010000:3.0:1789583888.807313:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789583889.527970:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0362f4f7-c01c-41c4-8e43-92ded75317bc 00010000:00010000:3.0:1789583889.832104:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789583890.485584:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485640:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485704:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485727:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485758:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485785:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583890.485840:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450368 00000100:00100000:1.0:1789583890.485851:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450368 00000100:00100000:1.0:1789583890.485915:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450496 00000100:00100000:1.0:1789583890.485919:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450496 00000100:00100000:3.0:1789583890.486022:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450112 00000100:00100000:3.0:1789583890.486027:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450112 00000100:00100000:3.0:1789583890.486064:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 105 00000100:00100000:3.0:1789583890.486084:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:2358:x1876514313450112:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:3.0:1789583890.486176:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:2358:x1876514313450112:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 94us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583890.486199:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 105 00000100:00100000:2.0:1789583890.486487:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450240 00000100:00100000:2.0:1789583890.486493:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450240 00000100:00100000:2.0:1789583890.486529:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450624 00000100:00100000:2.0:1789583890.486532:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450624 00000100:00100000:2.0:1789583890.486558:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583890.486567:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2358:x1876514313450240:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583890.486613:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2358:x1876514313450240:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 47us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583890.486627:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:2.0:1789583890.486648:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:2.0:1789583890.486657:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:2358:x1876514313450624:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:2.0:1789583890.486686:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:2358:x1876514313450624:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 30us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583890.486694:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:2.0:1789583890.486718:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450752 00000100:00100000:2.0:1789583890.486721:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450752 00000100:00100000:2.0:1789583890.486737:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313450880 00000100:00100000:2.0:1789583890.486740:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313450880 00000100:00100000:1.0:1789583890.486783:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789583890.486791:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313450368:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583890.486839:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675237480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313450368:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 50us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583890.486845:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:1.0:1789583890.486858:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:1.0:1789583890.486864:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313450752:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583890.486886:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675234a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313450752:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 22us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583890.486892:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:1.0:1789583890.486912:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789583890.487767:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789583890.487779:0:15115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789583890.487883:0:15114:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789583890.487898:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789583890.487908:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313450880:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583890.490336:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313450880:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 2413us (4532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583890.490354:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:1.0:1789583890.491612:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b675235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313450496:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:1.0:1789583890.491700:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b675235500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313450496:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 4781us (5993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583890.491709:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00080000:1.0:1789583890.491744:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789583890.491752:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583890.491756:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789583890.855047:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583891.497323:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332312320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789583891.497412:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583891.497521:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332312320 00000100:00100000:3.0:1789583891.497531:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332312320 00000100:00100000:3.0:1789583891.497599:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789583891.497610:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332312320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583891.497655:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583891.497705:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332312320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583891.497713:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789583891.497735:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583891.497778:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332312320:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1789583891.841158:0:16542:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe885a9a40 20000000:00000080:3.0:1789583891.841183:0:16542:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88b67f7a5c00 uarg=0000000000000000 20000000:01000000:3.0:1789583891.841232:0:16542:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789583891.841240:0:16542:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789583891.841246:0:16542:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789583891.847543:0:16543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789583891.847937:0:16542:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789583891.857847:0:16542:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789583891.857892:0:16542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.857917:0:16542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.857927:0:16542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.857935:0:16542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.857946:0:16542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.857954:0:16542:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.857962:0:16542:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.858040:0:16542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 12 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.858470:0:16542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 12 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.858493:0:16542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312448:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583891.858646:0:16542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.858657:0:16542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 12 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.858666:0:16542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312576:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583891.858701:0:16542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.858710:0:16542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.858721:0:16542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312704:0@lo:104: 00000100:00100000:1.0:1789583891.859231:0:16542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789583891.859318:0:16542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.859327:0:16542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 18 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.859365:0:16542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312832:0@lo:104: 00000100:00100000:1.0:1789583891.859403:0:16542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583891.865199:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332312704 00000100:00100000:0.0:1789583891.865219:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332312704 00000100:00100000:0.0:1789583891.865282:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332312832 00000100:00100000:0.0:1789583891.865286:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332312832 00000100:00100000:0.0:1789583891.865307:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583891.865317:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+4:16542:x1876514332312704:12345-0@lo:104: 00010000:00010000:0.0:1789583891.865340:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583891.865454:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789583891.865461:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+4:16542:x1876514332312704:12345-0@lo:104: Request processed in 146us (6230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583891.865469:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789583891.865489:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789583891.865495:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:16542:x1876514332312832:12345-0@lo:104: 00010000:00010000:0.0:1789583891.865504:0:14413:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583891.865541:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789583891.865546:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:16542:x1876514332312832:12345-0@lo:104: Request processed in 52us (6155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583891.865553:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789583891.865624:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789583891.865633:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865641:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55400 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:2.0:1789583891.865645:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865655:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583891.865663:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583891.865669:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789583891.865719:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865744:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789583891.865770:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865777:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e40b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e40b7 expref: -99 pid: 15830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865791:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583891.865795:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865800:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b641483800 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:2.0:1789583891.865827:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865835:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.865835:0:16542:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 18 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583891.865843:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583891.865847:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789583891.865850:0:16542:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 18 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865862:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.865865:0:16542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332313088:0@lo:104: 00010000:00010000:2.0:1789583891.865867:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789583891.865914:0:16542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789583891.865945:0:16542:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf480 going to sleep for 11 seconds 00010000:00010000:2.0:1789583891.865958:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.865965:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b641483800/0x6d3e73d72c6e3f7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f83 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.865971:0:16542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312704:0@lo:104: 00000100:00100000:1.0:1789583891.865980:0:16542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312832:0@lo:104: 00010000:00010000:2.0:1789583891.866059:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583891.866062:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583891.866063:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583891.866071:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583891.866085:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3305:1876514332313216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789583891.866120:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583891.866179:0:14414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789583891.866191:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313088 00000100:00100000:2.0:1789583891.866195:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313088 00000100:00100000:2.0:1789583891.866223:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789583891.866231:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676299050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:16542:x1876514332313088:12345-0@lo:104: 00000100:00100000:3.0:1789583891.866239:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332312960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789583891.866241:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583891.866268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789583891.866277:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789583891.866282:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676299050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+3:16542:x1876514332313088:12345-0@lo:104: Request processed in 53us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583891.866289:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789583891.866324:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789583891.866328:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866335:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b652cfbe00 already unused, calling callback (ffffffffc1bc3c20) 10000000:00010000:2.0:1789583891.866339:0:14418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866347:0:14418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789583891.866360:0:14418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789583891.866366:0:14418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789583891.866382:0:14418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866388:0:14418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789583891.866400:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866407:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.146@tcp lock: ffff88b652cfbe00/0x6d3e73d72c6e3f2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d3e73d72c6e3f36 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866435:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583891.866437:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583891.866438:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583891.866447:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332313344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583891.866467:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313216 00000100:00100000:1.0:1789583891.866471:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313216 00000100:00100000:2.0:1789583891.866473:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789583891.866495:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 19 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583891.866500:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332312960 00000100:00100000:2.0:1789583891.866503:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332312960 00000100:00100000:1.0:1789583891.866510:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313344 00000100:00100000:1.0:1789583891.866512:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313344 00010000:00010000:1.0:1789583891.866523:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 21 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866529:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 21 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.866535:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789583891.866540:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+21:3305:x1876514332313216:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789583891.866543:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789583891.866549:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789583891.866551:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583891.866556:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 21 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.866574:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 21 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.866590:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b652cfa200/0x6d3e73d72c6e3f83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f7c expref: 21 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.866606:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789583891.866630:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+20:3305:x1876514332313216:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583891.866636:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789583891.866650:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789583891.866656:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3306:x1876514332313344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789583891.866664:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789583891.866667:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3305:1876514332313216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789583891.866668:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 19 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.866676:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 19 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583891.866685:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583891.866707:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789583891.866708:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3306:x1876514332313344:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583891.866713:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3308:x1876514332312960:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789583891.866714:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789583891.866726:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583891.866731:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866740:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866749:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b66df54e00/0x6d3e73d72c6e40b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e40b0 expref: 18 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.866758:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583891.866785:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:3308:x1876514332312960:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583891.866791:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789583891.867192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583891.867389:0:16544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451136 00000100:00100000:2.0:1789583891.867396:0:16544:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451136 00000100:00100000:3.0:1789583891.868187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:2.0:1789583891.868381:0:16544:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 13 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583891.868411:0:16544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451008 00000100:00100000:2.0:1789583891.868429:0:16544:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451008 00010000:00010000:2.0:1789583891.868452:0:16544:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 14 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583891.868469:0:16544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789583891.868479:0:16544:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0cad7b4-080c-4110-a88b-60d42f235bfe+14:2359:x1876514313451136:12345-192.168.203.46@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789583891.868486:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00010000:00010000:2.0:1789583891.868494:0:16544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789583891.868495:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0cad7b4-080c-4110-a88b-60d42f235bfe+14:2359:x1876514313451008:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583891.868500:0:16544:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 14 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583891.868513:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583891.868516:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 14 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.868521:0:16544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 14 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583891.868540:0:14415:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1789583891.868551:0:14415:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789583891.868577:0:16542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312448:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583891.868586:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3306:1876514332313344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789583891.868589:0:16542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67c5f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332312576:192.168.203.46@tcp:104: 00010000:00010000:0.0:1789583891.868601:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b6756a1c00/0x6d3e73d72c6e3f36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d3e73d72c6e3f2f expref: 16 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583891.868616:0:16542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16542:1876514332313088:0@lo:104: 00010000:00010000:3.0:1789583891.871540:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 14 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583891.871580:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b542507800/0x6d3e73d72c6e4215 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec681f expref: 14 pid: 14423 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583891.871601:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583891.871715:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:2359:x1876514313451008:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 3219us (3532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583891.871728:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789583891.871861:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332312960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789583891.873229:0:16544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b542506e00/0x6d3e73d72c6e41dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67bd expref: 12 pid: 14424 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873260:0:16544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873271:0:16544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873300:0:16544:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873309:0:16544:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873316:0:16544:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873324:0:16544:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873331:0:16544:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583891.873336:0:16544:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873344:0:16544:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873379:0:16544:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583891.873393:0:16544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583891.873484:0:16544:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:2359:x1876514313451136:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 5005us (7130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583891.873495:0:16544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00010000:00010000:2.0:1789583891.879258:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789583891.880541:0:16542:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583891.880587:0:16542:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583891.880597:0:16542:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583891.880605:0:16542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88b542507c00/0x6d3e73d72c6e423f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16542 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583892.902983:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789583893.160793:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789583893.160844:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b666646800 from 10 10000000:01000000:0.0:1789583893.160851:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789583893.160918:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583893.160933:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583893.160947:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583893.160981:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789583893.161069:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583893.161136:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a062d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789583893.162018:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313472 00000100:00100000:2.0:1789583893.162030:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313472 00000100:00100000:2.0:1789583893.162092:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789583893.162102:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+16:14427:x1876514332313472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583893.162119:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583893.162137:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e424d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e4246 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583893.162166:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e424d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4246 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583893.162178:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b6756a1200/0x6d3e73d72c6e424d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4246 expref: 17 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583893.162188:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1200, rc 0) 00000100:00100000:2.0:1789583893.162249:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:14427:x1876514332313472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583893.162255:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789583893.162312:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789583893.162335:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e424d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583893.162345:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e424d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583893.162424:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789583893.162463:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583893.162490:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b649068240 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.162596:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313600 00000100:00100000:3.0:1789583893.162600:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313600 00000100:00100000:3.0:1789583893.162631:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789583893.162638:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:14427:x1876514332313600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.162938:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:14427:x1876514332313600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.162946:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789583893.162980:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752eb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.163012:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.163050:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.163068:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.163079:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313728 00000100:00100000:3.0:1789583893.163082:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313728 00000100:00100000:3.0:1789583893.163100:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789583893.163106:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:14427:x1876514332313728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.163248:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:14427:x1876514332313728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.163255:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789583893.163286:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789583893.164116:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789583893.164181:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789583893.164203:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583893.164214:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e424d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164225:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b66df55400/0x6d3e73d72c6e4246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e424d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583893.164235:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789583893.164238:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b67baec000 from 10 10000000:01000000:3.0:1789583893.164241:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789583893.164273:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164281:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164292:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583893.164323:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.164365:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.164384:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.164401:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313856 00000100:00100000:3.0:1789583893.164419:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313856 00000100:00100000:3.0:1789583893.164451:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789583893.164458:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+17:14427:x1876514332313856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583893.164470:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583893.164482:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e425b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e4254 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164506:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e425b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4254 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164517:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216e400/0x6d3e73d72c6e425b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4254 expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164525:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216e400, rc 0) 00000100:00100000:3.0:1789583893.164558:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332313856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.164564:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789583893.164603:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583893.164615:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e425b expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.164623:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e425b expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583893.164673:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.164700:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.164712:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.164723:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332313984 00000100:00100000:3.0:1789583893.164726:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332313984 00000100:00100000:3.0:1789583893.164746:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789583893.164751:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332313984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.164994:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332313984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.165001:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789583893.165030:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332313984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.165055:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.165092:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.165104:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b6926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.165115:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314112 00000100:00100000:3.0:1789583893.165118:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314112 00000100:00100000:3.0:1789583893.165140:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789583893.165146:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332314112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.165285:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332314112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.165293:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789583893.165330:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789583893.169910:0:16592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789583893.169997:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789583893.170026:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583893.170041:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e425b expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170056:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b68216f400/0x6d3e73d72c6e4254 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e425b expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789583893.170069:0:14427:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789583893.170073:0:14427:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88b674c49000 from 10 10000000:01000000:3.0:1789583893.170076:0:14427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789583893.170125:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170135:0:14427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170147:0:14427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583893.170176:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.170264:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.170317:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b67b692300 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.170342:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314240 00000100:00100000:3.0:1789583893.170349:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314240 00000100:00100000:3.0:1789583893.170398:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789583893.170421:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+18:14427:x1876514332314240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583893.170439:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583893.170454:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216f000/0x6d3e73d72c6e4269 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d3e73d72c6e4262 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170494:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216f000/0x6d3e73d72c6e4269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4262 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170505:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216f000/0x6d3e73d72c6e4269 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d3e73d72c6e4262 expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170516:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216f000, rc 0) 00000100:00100000:3.0:1789583893.170561:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332314240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.170568:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789583893.170625:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583893.170642:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e4269 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.170652:0:14427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d3e73d72c6e4269 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583893.170708:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.170735:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.170754:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64355ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.170767:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314368 00000100:00100000:3.0:1789583893.170771:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314368 00000100:00100000:3.0:1789583893.170793:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789583893.170800:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332314368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.171110:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332314368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.171128:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789583893.171160:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.171189:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.171233:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.171247:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64355ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789583893.171260:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314496 00000100:00100000:3.0:1789583893.171264:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314496 00000100:00100000:3.0:1789583893.171287:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789583893.171293:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b649e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332314496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789583893.171542:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b649e15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:14427:x1876514332314496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.171549:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789583893.171591:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:bec31d4c-70f2-4e81-b20d-79c0fd90522d:14427:1876514332314496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789583893.176552:0:16593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789583893.176753:0:14427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789583893.176779:0:14427:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.146@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789583893.176793:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e4269 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.176832:0:14427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.146@tcp lock: ffff88b68216f800/0x6d3e73d72c6e4262 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d3e73d72c6e4269 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583893.492569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583893.495834:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451264 00000100:00100000:1.0:1789583893.495857:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451264 00000100:00100000:1.0:1789583893.497581:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:1.0:1789583893.497598:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+11:13763:x1876514313451264:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789583893.497617:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583893.497636:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b542506a00/0x6d3e73d72c6e4270 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6850 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583893.497665:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b542506a00/0x6d3e73d72c6e4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6850 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583893.497676:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b542506a00/0x6d3e73d72c6e4270 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6850 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583893.497684:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542506a00, rc 0) 00000100:00100000:1.0:1789583893.497773:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13763:x1876514313451264:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 182us (5213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583893.497780:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 115 00000100:00100000:3.0:1789583893.503723:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583893.503958:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451392 00000100:00100000:0.0:1789583893.503968:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451392 00000100:00100000:0.0:1789583893.504124:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:0.0:1789583893.504146:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13763:x1876514313451392:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583893.504577:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13763:x1876514313451392:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 431us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583893.504586:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 116 00000100:00100000:2.0:1789583893.519915:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583893.519990:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451520 00000100:00100000:1.0:1789583893.520007:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451520 00000100:00100000:1.0:1789583893.520060:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:1.0:1789583893.520069:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13763:x1876514313451520:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789583893.520303:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13763:x1876514313451520:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 234us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583893.520312:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 117 00000100:00100000:2.0:1789583893.530066:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583893.531363:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451648 00000100:00100000:3.0:1789583893.531376:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451648 00000100:00100000:3.0:1789583893.531457:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789583893.531468:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+12:13763:x1876514313451648:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789583893.531487:0:14423:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583893.531506:0:14423:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e4277 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6857 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.531536:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e4277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6857 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.531547:0:14423:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88b68216fc00/0x6d3e73d72c6e4277 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6857 expref: 13 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583893.531556:0:14423:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b68216fc00, rc 0) 00000100:00100000:3.0:1789583893.531622:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13763:x1876514313451648:12345-192.168.203.46@tcp:101:ll_cfg_requeue.0 Request processed in 156us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.531629:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 118 00000100:00100000:3.0:1789583893.543467:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583893.543490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332314624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583893.543555:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.543627:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314624 00000100:00100000:3.0:1789583893.543634:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314624 00000100:00100000:3.0:1789583893.543698:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789583893.543708:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6763eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332314624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583893.543761:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583893.543840:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6763eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332314624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.543847:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789583893.543884:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583893.545157:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332314624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583893.545345:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332314752:0@lo:400:kworker.0 00000100:00100000:3.0:1789583893.545395:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.545434:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789583893.545440:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332315136:0@lo:400:kworker.0 00000100:00100000:3.0:1789583893.545468:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583893.545499:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332315136 00000100:00100000:3.0:1789583893.545505:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332315136 00000100:00100000:3.0:1789583893.545549:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789583893.545557:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332315136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583893.545602:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332315136:12345-0@lo:400:kworker.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583893.545608:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789583893.545627:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583893.545647:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332315136:0@lo:400:kworker.0 00000100:00100000:0.0:1789583893.545659:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314752 00000100:00100000:0.0:1789583893.545666:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314752 00000100:00100000:0.0:1789583893.545704:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789583893.545711:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332314752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583893.546226:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332314880:0@lo:400:kworker.0 00000100:00100000:2.0:1789583893.549194:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583893.549247:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789583893.549258:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6763ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332315008:0@lo:400:kworker.0 00000100:00100000:2.0:1789583893.549286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583893.549937:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332314880 00000100:00100000:2.0:1789583893.549946:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332314880 00000100:00100000:2.0:1789583893.549993:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332315008 00000100:00100000:2.0:1789583893.550385:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332315008 00000100:00100000:2.0:1789583893.550428:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789583893.550437:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332314880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583893.550506:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876514332314880:12345-0@lo:400:kworker.0 Request processed in 71us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583893.550513:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789583893.550531:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789583893.550537:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332315008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789583893.550575:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876514332315008:12345-0@lo:400:kworker.0 Request processed in 38us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583893.550581:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789583893.550635:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3305:1876514332315008:0@lo:400:kworker.0 00000100:00100000:2.0:1789583893.550645:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876514332314880:0@lo:400:kworker.0 00000100:00080000:1.0:1789583893.552444:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789583893.552452:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789583893.553701:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6763ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332314752:0@lo:400:kworker.0 00000100:00100000:0.0:1789583893.554068:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332314752:12345-0@lo:400:kworker.0 Request processed in 7545us (7860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583893.554079:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789583893.559070:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583893.559176:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451776 00000100:00100000:0.0:1789583893.559230:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451776 00000100:00100000:0.0:1789583893.559288:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:0.0:1789583893.559298:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13763:x1876514313451776:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789583893.559658:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13763:x1876514313451776:12345-192.168.203.46@tcp:501:ll_cfg_requeue.0 Request processed in 361us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583893.559674:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 119 00000100:00100000:0.0:1789583893.569610:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583893.569698:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313451904 00000100:00100000:1.0:1789583893.569710:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313451904 00000100:00100000:1.0:1789583893.569762:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 120 00000100:00100000:1.0:1789583893.569773:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13763:x1876514313451904:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789583893.574546:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:13763:x1876514313451904:12345-192.168.203.46@tcp:503:ll_cfg_requeue.0 Request processed in 4763us (4931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583893.574567:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 120 00010000:00010000:2.0:1789583893.935633:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789583894.950994:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583895.329910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.330024:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313452032 00000100:00100000:3.0:1789583895.330036:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313452032 00000100:00100000:3.0:1789583895.330135:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:3.0:1789583895.330150:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:14419:x1876514313452032:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583895.330178:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583895.330209:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f200/0x6d3e73d72c6e427e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec685e expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330292:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330331:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330348:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330365:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330374:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330381:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330771:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e4293 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330781:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e4293 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330788:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e4293 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583895.330848:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789583895.330852:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583895.330894:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e4293 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330907:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330925:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330932:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330938:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216ec00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583895.330943:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330953:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330967:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:3.0:1789583895.330970:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583895.330976:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330982:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ec00/0x6d3e73d72c6e4285 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.330996:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331001:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331007:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331010:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b68216ea00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583895.331019:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331025:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331032:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88b64165a400) 00010000:00010000:3.0:1789583895.331034:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583895.331037:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331042:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216ea00/0x6d3e73d72c6e428c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331077:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b68216f200/0x6d3e73d72c6e427e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec685e expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331155:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b641483800/0x6d3e73d72c6e4293 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec685e expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.331164:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88b64165a900) 00010000:00010000:3.0:1789583895.331166:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583895.331168:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b641483800, rc 0) 00000100:00100000:3.0:1789583895.331255:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:14419:x1876514313452032:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1109us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583895.331263:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00080000:1.0:1789583895.331417:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789583895.337332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.337742:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313452288 00000100:00100000:2.0:1789583895.337756:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313452288 00000100:00100000:3.0:1789583895.337956:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:3.0:1789583895.337970:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:14419:x1876514313452288:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583895.338027:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583895.338056:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e429a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6865 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.338155:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.338172:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.338187:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.344680:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.344703:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.344716:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.345768:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031000/0x6d3e73d72c6e42af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.345782:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031000/0x6d3e73d72c6e42af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.345791:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031000/0x6d3e73d72c6e42af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583895.345802:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789583895.346728:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346739:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346746:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346752:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640031c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583895.346757:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346765:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346780:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88b64165a900) 00010000:00010000:3.0:1789583895.346783:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583895.346787:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346793:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346858:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346865:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346871:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346887:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640031a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583895.346890:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346896:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346904:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88b64165a400) 00010000:00010000:3.0:1789583895.346906:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583895.346909:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.346915:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.348697:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b641482200/0x6d3e73d72c6e429a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6865 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.348721:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031000/0x6d3e73d72c6e42af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6865 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.348730:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64165a600) 00010000:00010000:3.0:1789583895.348733:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789583895.348736:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640031000, rc 0) 00000100:00100000:3.0:1789583895.348889:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14419:x1876514313452288:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 10921us (11572us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789583895.348898:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:0.0:1789583895.354303:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.355001:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313452416 00000100:00100000:3.0:1789583895.355033:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313452416 00000100:00100000:3.0:1789583895.355120:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:3.0:1789583895.355132:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14419:x1876514313452416:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789583895.355280:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14419:x1876514313452416:12345-192.168.203.46@tcp:59:lhsmtool_posix.0 Request processed in 150us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583895.355289:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789583895.388444:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.388767:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313452544 00000100:00100000:2.0:1789583895.388784:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313452544 00000100:00100000:2.0:1789583895.388915:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:2.0:1789583895.388928:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14425:x1876514313452544:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583895.388960:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583895.389145:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec686c expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389242:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389262:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389276:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389318:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389326:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389334:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389801:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389846:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389924:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389932:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.389936:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389945:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389960:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583895.389963:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.389969:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.389976:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e42c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390072:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390079:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390085:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390090:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.390093:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390100:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390109:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88b6583d4400) 00010000:00010000:2.0:1789583895.390111:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.390115:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390121:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390166:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec686c expref: 10 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390177:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583895.390180:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.390192:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec686c expref: 10 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.390205:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1a00, rc 0) 00000100:00100000:2.0:1789583895.390289:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14425:x1876514313452544:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1363us (1861us total) trans 0 rc 301/301 00000100:00100000:2.0:1789583895.390298:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 18 00000100:00100000:0.0:1789583895.393936:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.394629:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313452672 00000100:00100000:1.0:1789583895.394643:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313452672 00000100:00100000:1.0:1789583895.394769:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:1.0:1789583895.394783:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14425:x1876514313452672:12345-192.168.203.46@tcp:700:lfs.0 00000100:00100000:1.0:1789583895.394924:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14425:x1876514313452672:12345-192.168.203.46@tcp:700:lfs.0 Request processed in 144us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583895.394933:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583895.407896:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.407989:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313452928 00000100:00100000:3.0:1789583895.408003:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313452928 00000100:00100000:3.0:1789583895.408077:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 19 00000100:00100000:3.0:1789583895.408089:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14425:x1876514313452928:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:3.0:1789583895.408170:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583895.408206:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1000/0x6d3e73d72c6e4200 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec67e7 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.408232:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:3.0:1789583895.408239:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583895.408712:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.408730:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 5 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.408740:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.408786:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 5 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.408877:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 5 pid: 14431 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583895.408895:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14432:1876514332315264:192.168.203.46@tcp:104: 00000100:00100000:3.0:1789583895.409023:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a1b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789583895.413603:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14432:1876514332315264:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583895.413647:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583895.418746:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.419147:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313453056 00000100:00100000:1.0:1789583895.419162:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313453056 00010000:00010000:1.0:1789583895.419245:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 6 pid: 14431 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583895.419301:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:1.0:1789583895.419313:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:2358:x1876514313453056:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789583895.419341:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789583895.419351:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 6 pid: 14431 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.419367:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 6 pid: 14431 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.419642:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4238 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6849 expref: 6 pid: 14431 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.419663:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:1.0:1789583895.419669:0:14415:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.419680:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.419688:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.419737:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583895.419783:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.419795:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583895.419855:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313453056:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 544us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583895.419865:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00010000:00010000:2.0:1789583895.419870:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.419882:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.419892:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789583895.420189:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1789583895.424365:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789583895.424405:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.424419:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.424427:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.424447:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640031a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.424452:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.424472:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.425837:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b6583d4500) 00010000:00010000:2.0:1789583895.425850:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.425869:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.425880:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031a00/0x6d3e73d72c6e42d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583895.425912:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b842207a reply state 00000000b1afc1f4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583895.425923:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583895.426074:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:14425:x1876514313452928:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 17980us (18186us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789583895.426086:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 19 00010000:00010000:2.0:1789583895.432761:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.432785:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.432794:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.432859:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.432865:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.432876:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.432899:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88b6583d4400) 00010000:00010000:2.0:1789583895.432902:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.432908:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.432916:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42d9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583895.500364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.500640:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313453184 00000100:00100000:3.0:1789583895.500654:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313453184 00000100:00100000:3.0:1789583895.500736:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:3.0:1789583895.500748:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:14433:x1876514313453184:12345-192.168.203.46@tcp:101:lctl.0 00010000:00010000:3.0:1789583895.500782:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583895.500857:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6873 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.500943:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031e00/0x6d3e73d72c6e42e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.500959:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031e00/0x6d3e73d72c6e42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.500972:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031e00/0x6d3e73d72c6e42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583895.501050:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789583895.501055:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789583895.501100:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031e00/0x6d3e73d72c6e42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.501131:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6873 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.501153:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031e00/0x6d3e73d72c6e42e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6873 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.501163:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:3.0:1789583895.501166:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789583895.501170:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640031e00, rc 0) 00000100:00100000:3.0:1789583895.501237:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:14433:x1876514313453184:12345-192.168.203.46@tcp:101:lctl.0 Request processed in 491us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583895.501244:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 20 00000100:00100000:0.0:1789583895.532293:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.532638:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313453312 00000100:00100000:2.0:1789583895.532651:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313453312 00000100:00100000:2.0:1789583895.532733:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:2.0:1789583895.532746:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:14434:x1876514313453312:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583895.532773:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583895.532800:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec687a expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.532930:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.532948:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.532986:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583895.533031:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789583895.533036:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583895.533061:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.533091:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e42ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec687a expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.533114:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0200/0x6d3e73d72c6e42f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec687a expref: 6 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.533123:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:2.0:1789583895.533126:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583895.533130:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0200, rc 0) 00000100:00100000:2.0:1789583895.533211:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:14434:x1876514313453312:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 467us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583895.533219:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 21 00000100:00100000:0.0:1789583895.545285:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.545645:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313453440 00000100:00100000:3.0:1789583895.545659:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313453440 00000100:00100000:3.0:1789583895.545856:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:3.0:1789583895.545871:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+6:14434:x1876514313453440:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:3.0:1789583895.545902:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583895.545929:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6881 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.546268:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.546311:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.546325:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.546343:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.546351:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.546357:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.548832:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4311 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.548857:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.548884:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583895.549064:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789583895.549074:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583895.549124:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4311 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549145:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549153:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549185:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549192:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640030200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.549197:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549206:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549224:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:2.0:1789583895.549228:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.549234:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549242:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030200/0x6d3e73d72c6e4303 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549266:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549273:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549279:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549284:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640030c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.549287:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549304:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549313:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88b64165a500) 00010000:00010000:2.0:1789583895.549316:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.549319:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549326:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030c00/0x6d3e73d72c6e430a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549381:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e42fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6881 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549422:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4311 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6881 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.549430:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b64165ab00) 00010000:00010000:2.0:1789583895.549432:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789583895.549435:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640030000, rc 0) 00000100:00100000:2.0:1789583895.549714:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+7:14434:x1876514313453440:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 3844us (4442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583895.549725:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 22 00000100:00100000:0.0:1789583895.558318:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.558437:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313453696 00000100:00100000:2.0:1789583895.558450:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313453696 00000100:00100000:2.0:1789583895.558540:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:2.0:1789583895.558552:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+7:14434:x1876514313453696:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:2.0:1789583895.558600:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583895.558629:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6888 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583895.558767:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789583895.558997:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4318 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6888 expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.559013:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:2.0:1789583895.559016:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789583895.559023:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6888 expref: 9 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.559040:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1a00, rc 0) 00000100:00100000:2.0:1789583895.559110:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+8:14434:x1876514313453696:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 560us (806us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789583895.559118:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 23 00000100:00100000:0.0:1789583895.565912:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.566011:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313453952 00000100:00100000:2.0:1789583895.566023:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313453952 00000100:00100000:2.0:1789583895.566099:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 24 00000100:00100000:2.0:1789583895.566110:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0362f4f7-c01c-41c4-8e43-92ded75317bc+8:14434:x1876514313453952:12345-192.168.203.46@tcp:36:lfs.0 00010000:00010000:2.0:1789583895.566183:0:15413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583895.566218:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4311 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6881 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.566242:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b64165ab00) 00010000:00010000:2.0:1789583895.566255:0:15413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583895.566306:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.566322:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.566334:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789583895.566645:0:15413:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000813d847c reply state 00000000dc24fd46 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583895.566657:0:15413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789583895.566667:0:15413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789583895.566784:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0362f4f7-c01c-41c4-8e43-92ded75317bc+9:14434:x1876514313453952:12345-192.168.203.46@tcp:36:lfs.0 Request processed in 675us (886us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789583895.566792:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 24 00010000:00010000:1.0:1789583895.570290:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.570314:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.570323:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.570329:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583895.570335:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.570366:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.570402:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b6583d4400) 00010000:00010000:1.0:1789583895.570406:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789583895.570413:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.570420:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1a00/0x6d3e73d72c6e4326 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583895.572252:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.572949:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313454208 00000100:00100000:3.0:1789583895.572965:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313454208 00000100:00100000:3.0:1789583895.573150:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789583895.573162:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+8:14434:x1876514313454208:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789583895.573587:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+9:14434:x1876514313454208:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 426us (1346us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789583895.573613:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:0.0:1789583895.580741:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.580907:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313454464 00000100:00100000:1.0:1789583895.580920:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313454464 00000100:00100000:1.0:1789583895.581005:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:1.0:1789583895.581017:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+9:14434:x1876514313454464:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583895.581051:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583895.581077:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e432d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec688f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581172:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581189:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581202:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581219:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581244:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581252:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583895.581570:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789583895.581688:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581764:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581771:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581778:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583895.581783:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581792:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581833:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:1.0:1789583895.581837:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583895.581843:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581849:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e4334 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581878:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581884:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581891:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581897:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583895.581899:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581906:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581914:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88b645246600) 00010000:00010000:1.0:1789583895.581916:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583895.581919:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581925:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e433b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.581976:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e432d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec688f expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.582042:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:1.0:1789583895.582044:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583895.582055:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e432d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec688f expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.582065:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507c00, rc 0) 00000100:00100000:1.0:1789583895.582209:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+10:14434:x1876514313454464:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 1194us (1484us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789583895.582219:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 25 00000100:00100000:0.0:1789583895.586132:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.586218:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313454592 00000100:00100000:1.0:1789583895.586232:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313454592 00000100:00100000:1.0:1789583895.586308:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:1.0:1789583895.586320:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0362f4f7-c01c-41c4-8e43-92ded75317bc+10:14434:x1876514313454592:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583895.586355:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583895.586404:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e4349 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec6896 expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.586655:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.586673:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.586688:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583895.586792:0:15413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789583895.586797:0:15413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583895.586848:0:15413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.586884:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e4349 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 12 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.586926:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 11 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.586937:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b645246d00) 00010000:00010000:1.0:1789583895.586940:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789583895.586945:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507600, rc 0) 00000100:00100000:1.0:1789583895.587209:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0362f4f7-c01c-41c4-8e43-92ded75317bc+11:14434:x1876514313454592:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 891us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583895.587219:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 26 00000100:00100000:0.0:1789583895.591400:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.591488:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313454720 00000100:00100000:1.0:1789583895.591509:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313454720 00000100:00100000:1.0:1789583895.591582:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:1.0:1789583895.591594:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+11:14434:x1876514313454720:12345-192.168.203.46@tcp:37:lfs.0 00000100:00100000:1.0:1789583895.599584:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0362f4f7-c01c-41c4-8e43-92ded75317bc+11:14434:x1876514313454720:12345-192.168.203.46@tcp:37:lfs.0 Request processed in 7976us (8192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583895.599600:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789583895.604465:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.604618:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313454976 00000100:00100000:3.0:1789583895.604633:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313454976 00000100:00100000:3.0:1789583895.604712:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:3.0:1789583895.604725:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b647f30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+11:14434:x1876514313454976:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:3.0:1789583895.605064:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b647f30450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+12:14434:x1876514313454976:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 341us (613us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789583895.605072:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:2.0:1789583895.609014:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.609056:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.609092:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.609126:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.609161:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.609194:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313455232 00000100:00100000:2.0:1789583895.609207:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313455232 00000100:00100000:2.0:1789583895.609267:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313455488 00000100:00100000:2.0:1789583895.609271:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313455488 00000100:00100000:2.0:1789583895.609286:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313455360 00000100:00100000:2.0:1789583895.609289:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313455360 00000100:00100000:2.0:1789583895.609303:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313455616 00000100:00100000:2.0:1789583895.609306:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313455616 00000100:00100000:2.0:1789583895.609323:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789583895.609334:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313455232:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583895.609624:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313455104 00000100:00100000:0.0:1789583895.609630:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313455104 00000100:00100000:0.0:1789583895.609674:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:0.0:1789583895.609681:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:2358:x1876514313455104:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583895.609752:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f0cad7b4-080c-4110-a88b-60d42f235bfe+13:2358:x1876514313455104:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 71us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583895.609760:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 121 00000100:00100000:0.0:1789583895.609800:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583895.609835:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313455488:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583895.609864:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313455488:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 57us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583895.609871:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:0.0:1789583895.609888:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789583895.609895:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313455360:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583895.609930:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313455360:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 35us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583895.609937:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:0.0:1789583895.609949:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789583895.609956:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313455616:12345-192.168.203.46@tcp:400:kworker.0 00000100:00100000:0.0:1789583895.609980:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0362f4f7-c01c-41c4-8e43-92ded75317bc+5:2358:x1876514313455616:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 24us (818us total) trans 0 rc 0/0 00000100:00080000:3.0:1789583895.609983:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789583895.609985:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00080000:3.0:1789583895.609989:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789583895.610150:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313455232:12345-192.168.203.46@tcp:400:kworker.0 Request processed in 816us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583895.610158:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:2.0:1789583895.674863:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.675027:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313455744 00000100:00100000:1.0:1789583895.675041:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313455744 00000100:00100000:1.0:1789583895.675166:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:1.0:1789583895.675180:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:14440:x1876514313455744:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:1.0:1789583895.675208:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583895.675235:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e4357 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec689d expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675442:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675478:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675493:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675511:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675520:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675528:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675651:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e436c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675660:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e436c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675667:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e436c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583895.675702:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789583895.675706:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583895.675753:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e436c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675767:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675784:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675791:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675798:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583895.675835:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675845:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675859:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:1.0:1789583895.675862:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583895.675868:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675874:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e435e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675891:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675897:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675903:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675908:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542506e00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583895.675917:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675924:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675934:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88b645246600) 00010000:00010000:1.0:1789583895.675936:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583895.675939:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.675945:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e4365 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.676114:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e4357 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec689d expref: 12 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.676132:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507800/0x6d3e73d72c6e436c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec689d expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.676141:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b645246d00) 00010000:00010000:1.0:1789583895.676144:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789583895.676147:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507800, rc 0) 00000100:00100000:1.0:1789583895.676299:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+11:14440:x1876514313455744:12345-192.168.203.46@tcp:101:bash.0 Request processed in 1122us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583895.676394:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 27 00000100:00100000:0.0:1789583895.681629:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.681752:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313456000 00000100:00100000:2.0:1789583895.681767:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313456000 00000100:00100000:2.0:1789583895.681879:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 28 00000100:00100000:2.0:1789583895.681891:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+11:14440:x1876514313456000:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583895.681923:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583895.681951:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e4373 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68a4 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.682127:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.682145:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 11 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.682155:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.682200:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 11 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.682217:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 11 pid: 15413 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583895.682233:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1876514332315392:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583895.682377:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b541bba540 going to sleep for 11 seconds 00000100:00100000:2.0:1789583895.685405:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1876514332315392:192.168.203.46@tcp:104: 00010000:00010000:2.0:1789583895.685444:0:14430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583895.687779:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.688345:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313456128 00000100:00100000:3.0:1789583895.688361:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313456128 00010000:00010000:3.0:1789583895.688432:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 12 pid: 15413 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583895.688488:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:3.0:1789583895.688500:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0362f4f7-c01c-41c4-8e43-92ded75317bc+12:2361:x1876514313456128:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789583895.688519:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583895.688529:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 12 pid: 15413 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.688545:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 12 pid: 15413 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.688574:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e4350 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec6896 expref: 12 pid: 15413 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.688617:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b645246d00) 00010000:00010000:3.0:1789583895.688624:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.688635:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.688645:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583895.688684:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583895.689192:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0362f4f7-c01c-41c4-8e43-92ded75317bc+11:2361:x1876514313456128:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 690us (1423us total) trans 0 rc 0/0 00010000:00010000:0.0:1789583895.689612:0:14430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.689624:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.689656:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.689669:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.689678:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583895.690150:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00010000:00010000:0.0:1789583895.693876:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.693908:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.693940:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583895.693959:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789583895.694119:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694128:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694136:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694142:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583895.694147:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694156:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694170:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b645246d00) 00010000:00010000:0.0:1789583895.694173:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583895.694179:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694186:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1800/0x6d3e73d72c6e437a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789583895.694202:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a4791d0 reply state 0000000059622e02 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583895.694224:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789583895.694276:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0a00/0x6d3e73d72c6e4373 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 14 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694292:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 13 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.694484:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:0.0:1789583895.694487:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789583895.694490:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54200, rc 0) 00000100:00100000:0.0:1789583895.694664:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+14:14440:x1876514313456000:12345-192.168.203.46@tcp:101:bash.0 Request processed in 12774us (13047us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789583895.694674:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 28 00010000:00010000:2.0:1789583895.704241:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.704266:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.704276:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.704284:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583895.704291:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.704311:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.704334:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88b643e76100) 00010000:00010000:2.0:1789583895.704337:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583895.704345:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.704353:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4381 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583895.718682:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.720520:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313456256 00000100:00100000:3.0:1789583895.720541:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313456256 00000100:00100000:2.0:1789583895.720931:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:2.0:1789583895.720945:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+13:14440:x1876514313456256:12345-192.168.203.46@tcp:101:bash.0 00010000:00010000:2.0:1789583895.721018:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583895.721048:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4396 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68ab expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721137:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721156:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721171:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583895.721222:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789583895.721227:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789583895.721254:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721268:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721297:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4396 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721332:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.721343:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583895.721346:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583895.721351:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a1c00, rc 0) 00000100:00100000:2.0:1789583895.721461:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+14:14440:x1876514313456256:12345-192.168.203.46@tcp:101:bash.0 Request processed in 519us (2794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583895.721469:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 29 00000100:00100000:0.0:1789583895.724980:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583895.725134:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313456512 00000100:00100000:3.0:1789583895.725147:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313456512 00000100:00100000:3.0:1789583895.725222:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:3.0:1789583895.725236:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+14:14440:x1876514313456512:12345-192.168.203.46@tcp:35:bash.0 00000100:00100000:3.0:1789583895.725715:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+15:14440:x1876514313456512:12345-192.168.203.46@tcp:35:bash.0 Request processed in 480us (747us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789583895.725723:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583895.824294:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.824554:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313456768 00000100:00100000:1.0:1789583895.824568:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313456768 00000100:00100000:1.0:1789583895.824648:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:1.0:1789583895.824678:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+15:14450:x1876514313456768:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583895.824779:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583895.824907:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e43a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68b2 expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583895.825097:0:15413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789583895.825257:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e43a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68b2 expref: 17 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.825274:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88b64165a400) 00010000:00010000:1.0:1789583895.825278:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789583895.825284:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e43a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68b2 expref: 17 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.825507:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542506e00, rc 0) 00000100:00100000:1.0:1789583895.825594:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+16:14450:x1876514313456768:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 919us (1315us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789583895.825603:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 30 00000100:00100000:3.0:1789583895.829873:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.830142:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313457024 00000100:00100000:2.0:1789583895.830156:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313457024 00000100:00100000:2.0:1789583895.830228:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:2.0:1789583895.830239:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+16:14450:x1876514313457024:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583895.830731:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+17:14450:x1876514313457024:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 491us (928us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789583895.830740:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:0.0:1789583895.874273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583895.874553:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313457280 00000100:00100000:1.0:1789583895.874567:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313457280 00000100:00100000:1.0:1789583895.874650:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:1.0:1789583895.874663:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+17:14453:x1876514313457280:12345-192.168.203.46@tcp:101:lfs.0 00010000:00010000:1.0:1789583895.874854:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583895.874883:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e43b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68b9 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.875131:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e43b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.875165:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e43b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.875180:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e43b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583895.875197:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789583895.875519:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506e00/0x6d3e73d72c6e43b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68b9 expref: 20 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.875544:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e43b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68b9 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583895.875555:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:1.0:1789583895.875558:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789583895.875562:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507c00, rc 0) 00000100:00100000:1.0:1789583895.875649:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+19:14453:x1876514313457280:12345-192.168.203.46@tcp:101:lfs.0 Request processed in 988us (1392us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789583895.875658:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 31 00000100:00100000:3.0:1789583895.879945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583895.880187:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313457408 00000100:00100000:0.0:1789583895.880201:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313457408 00000100:00100000:0.0:1789583895.880278:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:0.0:1789583895.880291:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+19:14453:x1876514313457408:12345-192.168.203.46@tcp:54:lfs.0 00010000:00010000:0.0:1789583895.880412:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880434:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880448:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880500:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880507:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880515:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880521:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583895.880526:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880535:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880550:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:0.0:1789583895.880554:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789583895.880560:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583895.880566:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55a00/0x6d3e73d72c6e43c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583895.880671:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+19:14453:x1876514313457408:12345-192.168.203.46@tcp:54:lfs.0 Request processed in 379us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583895.880681:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 32 00000100:00100000:3.0:1789583895.883325:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.883546:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313457664 00000100:00100000:2.0:1789583895.883560:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313457664 00000100:00100000:2.0:1789583895.883632:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:2.0:1789583895.883646:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+19:14453:x1876514313457664:12345-192.168.203.46@tcp:35:lfs.0 00000100:00100000:2.0:1789583895.884120:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+20:14453:x1876514313457664:12345-192.168.203.46@tcp:35:lfs.0 Request processed in 474us (806us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789583895.884130:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:3.0:1789583895.887446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583895.887576:0:16544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313457792 00000100:00100000:2.0:1789583895.887590:0:16544:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313457792 00000100:00100000:2.0:1789583895.887679:0:16544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:2.0:1789583895.887692:0:16544:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+20:2361:x1876514313457792:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583895.887723:0:16544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583895.887758:0:16544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e43b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68b9 expref: 20 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583895.887784:0:16544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583895.887797:0:16544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583895.888047:0:16544:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+19:2361:x1876514313457792:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 356us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583895.888056:0:16544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00010000:00010000:2.0:1789583895.975112:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583896.134197:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.134551:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313458048 00000100:00100000:2.0:1789583896.134565:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313458048 00000100:00100000:2.0:1789583896.134645:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:2.0:1789583896.134658:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+19:14484:x1876514313458048:12345-192.168.203.46@tcp:101:cat.0 00010000:00010000:2.0:1789583896.134693:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583896.134729:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e43ce lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68c0 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.134904:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43d5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.134923:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.134940:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43d5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789583896.134954:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789583896.135280:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e43ce lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68c0 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.135304:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43d5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68c0 expref: 21 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.135335:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.135338:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789583896.135343:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0400, rc 0) 00000100:00100000:2.0:1789583896.135511:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:14484:x1876514313458048:12345-192.168.203.46@tcp:101:cat.0 Request processed in 854us (1327us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789583896.135518:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 33 00000100:00100000:3.0:1789583896.142651:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.143431:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313458304 00000100:00100000:2.0:1789583896.143445:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313458304 00000100:00100000:2.0:1789583896.143521:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:2.0:1789583896.143533:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:14484:x1876514313458304:12345-192.168.203.46@tcp:35:cat.0 00000100:00100000:2.0:1789583896.143977:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+22:14484:x1876514313458304:12345-192.168.203.46@tcp:35:cat.0 Request processed in 445us (1340us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789583896.145180:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 8 00000100:00100000:3.0:1789583896.145340:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.145792:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313458432 00000100:00100000:2.0:1789583896.145832:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313458432 00000100:00100000:2.0:1789583896.145902:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:2.0:1789583896.145911:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+22:2358:x1876514313458432:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583896.145929:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583896.145960:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43d5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68c0 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.150245:0:14415:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.150265:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583896.150399:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:2358:x1876514313458432:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 4467us (5037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.150432:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:3.0:1789583896.218268:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583896.218417:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313458688 00000100:00100000:1.0:1789583896.218431:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313458688 00000100:00100000:1.0:1789583896.218523:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:1.0:1789583896.218535:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:14490:x1876514313458688:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:1.0:1789583896.218570:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583896.218597:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506c00/0x6d3e73d72c6e43e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68c7 expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.218775:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.218795:0:15413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.218836:0:15413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.218846:0:15413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.218886:0:15413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.218902:0:15413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 22 pid: 14432 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583896.218917:0:15413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332315520:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583896.219046:0:15413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.219060:0:15413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583896.219070:0:15413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332315648:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583896.219934:0:15413:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf180 going to sleep for 11 seconds 00000100:00100000:3.0:1789583896.226575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.226688:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313458816 00000100:00100000:2.0:1789583896.226702:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313458816 00010000:00010000:2.0:1789583896.226756:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 23 pid: 14432 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583896.226771:0:15413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332315520:192.168.203.46@tcp:104: 00000100:00100000:2.0:1789583896.226852:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789583896.226862:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+23:2358:x1876514313458816:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583896.226881:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583896.226889:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 23 pid: 14432 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.226903:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 23 pid: 14432 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.226930:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e439d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ab expref: 23 pid: 14432 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.226949:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.226955:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.226965:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.226973:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583896.227032:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+22:2358:x1876514313458816:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 171us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.227059:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:3.0:1789583896.229309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583896.229444:0:15413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332315648:192.168.203.46@tcp:104: 00010000:00010000:1.0:1789583896.229482:0:15413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.229623:0:16544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313458944 00000100:00100000:2.0:1789583896.229632:0:16544:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313458944 00010000:00010000:2.0:1789583896.229674:0:16544:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.229717:0:16544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:2.0:1789583896.229728:0:16544:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+22:2358:x1876514313458944:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583896.229745:0:16544:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583896.229753:0:16544:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.229766:0:16544:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.229791:0:16544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4388 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68a4 expref: 22 pid: 14430 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.229845:0:16544:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.229852:0:16544:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.229863:0:16544:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.229872:0:16544:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.229928:0:16544:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789583896.229994:0:16544:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:2358:x1876514313458944:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 268us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.230002:0:16544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00010000:00010000:3.0:1789583896.230625:0:15413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.230636:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583896.230660:0:15413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789583896.231190:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506c00/0x6d3e73d72c6e43e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68c7 expref: 22 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.231326:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506200/0x6d3e73d72c6e43ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68c7 expref: 21 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.231337:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:3.0:1789583896.231340:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789583896.231344:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542506200, rc 0) 00000100:00100000:3.0:1789583896.231453:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:14490:x1876514313458688:12345-192.168.203.46@tcp:101:dd.0 Request processed in 12921us (13213us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789583896.231462:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 34 00000100:00100000:1.0:1789583896.234935:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.235086:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313459200 00000100:00100000:2.0:1789583896.235099:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313459200 00000100:00100000:2.0:1789583896.235167:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 35 00000100:00100000:2.0:1789583896.235179:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+21:14490:x1876514313459200:12345-192.168.203.46@tcp:36:dd.0 00010000:00010000:2.0:1789583896.235625:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.235645:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.235658:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583896.235866:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789583896.235911:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000af0290 reply state 00000000fa938059 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.235921:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583896.236040:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14490:x1876514313459200:12345-192.168.203.46@tcp:36:dd.0 Request processed in 861us (1118us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789583896.236048:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 35 00000020:00080000:2.0:1789583896.236054:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789583896.238778:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:1.0:1789583896.241425:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.241451:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.241461:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.241468:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:1.0:1789583896.241476:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.241485:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.241572:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:1.0:1789583896.241576:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789583896.241582:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.241588:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e43f8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.242192:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313459328 00000100:00100000:2.0:1789583896.242205:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313459328 00000100:00100000:2.0:1789583896.242328:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:2.0:1789583896.242351:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+23:14490:x1876514313459328:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:2.0:1789583896.242396:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583896.242420:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43ff lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68ce expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.242556:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ce expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.242574:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43ff lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ce expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.242597:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.242600:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583896.242604:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b6756a0400, rc 0) 00000100:00100000:2.0:1789583896.242684:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14490:x1876514313459328:12345-192.168.203.46@tcp:101:dd.0 Request processed in 337us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.242691:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 36 00000100:00100000:0.0:1789583896.254203:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.254362:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313459584 00000100:00100000:3.0:1789583896.254375:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313459584 00000100:00100000:3.0:1789583896.254474:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789583896.254487:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14490:x1876514313459584:12345-192.168.203.46@tcp:103:dd.0 00010000:00010000:3.0:1789583896.254528:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789583896.254562:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e43ff lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ce expref: 24 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.254586:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:3.0:1789583896.254593:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789583896.254665:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+23:14490:x1876514313459584:12345-192.168.203.46@tcp:103:dd.0 Request processed in 181us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583896.254672:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:1.0:1789583896.257681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.258180:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313459712 00000100:00100000:2.0:1789583896.258195:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313459712 00000100:00100000:2.0:1789583896.258294:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:2.0:1789583896.258304:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+23:14490:x1876514313459712:12345-192.168.203.46@tcp:58:dd.0 00010000:00010000:2.0:1789583896.258436:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.258458:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.258472:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583896.259936:0:14431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789583896.261585:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789583896.261702:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789583896.261896:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+23:14490:x1876514313459712:12345-192.168.203.46@tcp:58:dd.0 Request processed in 3586us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.261912:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 37 00000100:00100000:0.0:1789583896.265258:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.265507:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313459840 00000100:00100000:3.0:1789583896.265520:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313459840 00000100:00100000:3.0:1789583896.265598:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 38 00000100:00100000:3.0:1789583896.265609:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+23:14490:x1876514313459840:12345-192.168.203.46@tcp:101:dd.0 00010000:00010000:3.0:1789583896.265634:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583896.265659:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68d5 expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.265739:0:15413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.265751:0:15413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 24 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.265775:0:15413:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.265789:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 24 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.266036:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:3.0:1789583896.266040:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789583896.266046:0:15413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 24 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.266055:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640031600, rc 0) 00000100:00100000:3.0:1789583896.266178:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14490:x1876514313459840:12345-192.168.203.46@tcp:101:dd.0 Request processed in 570us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583896.266186:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 38 00000040:00080000:2.0:1789583896.296910:0:14462:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789583896.296923:0:14462:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583896.296964:0:14462:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789583896.296971:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789583896.297150:0:14462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14462:1876514332315776:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789583896.297277:0:14462:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a25de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789583896.301029:0:14462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14462:1876514332315776:192.168.203.46@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789583896.305215:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.305369:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313459968 00000100:00100000:3.0:1789583896.305391:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313459968 00000100:00100000:3.0:1789583896.305454:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:3.0:1789583896.305467:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313459968:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789583896.305984:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313459968:12345-192.168.203.46@tcp:900:lhsmtool_posix.0 Request processed in 517us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583896.305994:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583896.308359:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.308471:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313460096 00000100:00100000:2.0:1789583896.308483:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313460096 00000100:00100000:2.0:1789583896.308580:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:2.0:1789583896.308591:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313460096:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789583896.308632:0:14431:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789583896.308791:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313460096:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 201us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.308798:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 39 00000100:00100000:3.0:1789583896.314850:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.318021:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313460224 00000100:00100000:0.0:1789583896.318041:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313460224 00000100:00100000:0.0:1789583896.318255:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:0.0:1789583896.318267:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313460224:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789583896.318364:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.318525:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.318542:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.321963:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322107:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322124:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322157:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322167:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322173:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789583896.322239:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789583896.322243:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789583896.322261:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322273:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322280:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322286:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322292:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583896.322296:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322303:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322317:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64165a600) 00010000:00010000:0.0:1789583896.322320:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583896.322325:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322331:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e4414 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322346:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322362:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322367:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322372:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583896.322376:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322393:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322401:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88b643e76f00) 00010000:00010000:0.0:1789583896.322403:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583896.322406:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322410:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e441b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322426:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322431:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322436:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322440:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54200 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583896.322450:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322455:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322463:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:0.0:1789583896.322465:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583896.322468:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.322473:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4422 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583896.322561:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313460224:12345-192.168.203.46@tcp:34:lhsmtool_posix.0 Request processed in 4292us (7767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583896.322571:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 40 00000100:00100000:1.0:1789583896.326360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.326540:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313460480 00000100:00100000:3.0:1789583896.326552:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313460480 00000100:00100000:3.0:1789583896.326657:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:3.0:1789583896.326669:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+24:14491:x1876514313460480:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583896.326697:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583896.326724:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4429 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68dc expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.326915:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.326936:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.326952:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789583896.326966:0:15413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789583896.327224:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327233:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327241:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327247:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640031c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:3.0:1789583896.327253:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327261:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327276:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:3.0:1789583896.327279:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789583896.327285:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327306:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4430 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327361:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4429 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68dc expref: 26 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327371:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88b64165a600) 00010000:00010000:3.0:1789583896.327374:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789583896.327377:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4429 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68dc expref: 26 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.327398:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640030000, rc 0) 00000100:00100000:3.0:1789583896.327495:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+25:14491:x1876514313460480:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 828us (1150us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789583896.327505:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 41 00000100:00100000:1.0:1789583896.335218:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.339302:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313460608 00000100:00100000:2.0:1789583896.339323:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313460608 00000100:00100000:2.0:1789583896.339576:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:2.0:1789583896.339591:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+25:14491:x1876514313460608:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789583896.339661:0:14430:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789583896.339865:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+25:14491:x1876514313460608:12345-192.168.203.46@tcp:53:lhsmtool_posix.0 Request processed in 278us (4662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.339873:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 42 00000100:00100000:0.0:1789583896.344675:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.344802:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313460864 00000100:00100000:2.0:1789583896.344856:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313460864 00000100:00100000:2.0:1789583896.344935:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:2.0:1789583896.344948:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+25:14491:x1876514313460864:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789583896.344976:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789583896.345004:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1e00/0x6d3e73d72c6e443e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68e3 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789583896.348732:0:14431:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1789583896.348748:0:14431:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789583896.348988:0:14431:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789583896.349605:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4445 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.349630:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.349647:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4445 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.349739:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1e00/0x6d3e73d72c6e443e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68e3 expref: 28 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.349983:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4445 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68e3 expref: 27 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.349996:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b643e76f00) 00010000:00010000:0.0:1789583896.350000:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789583896.350005:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b66df54200, rc 0) 00000100:00100000:0.0:1789583896.350115:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+27:14491:x1876514313460864:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 5170us (5455us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789583896.350126:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 43 00000100:00100000:1.0:1789583896.362400:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.362968:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313461120 00000100:00100000:0.0:1789583896.363048:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313461120 00000100:00100000:0.0:1789583896.363182:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:0.0:1789583896.363204:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+27:14491:x1876514313461120:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789583896.363276:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789583896.363310:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54200/0x6d3e73d72c6e4445 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68e3 expref: 27 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.363334:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b643e76f00) 00010000:00010000:0.0:1789583896.363347:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789583896.363376:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.363405:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.363417:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366290:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366312:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366490:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366569:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366577:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366584:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366590:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583896.366594:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.366601:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367077:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff88b645246d00) 00010000:00010000:0.0:1789583896.367081:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583896.367086:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367092:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df55600/0x6d3e73d72c6e4453 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367122:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367128:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367134:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367139:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54a00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583896.367141:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367148:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367156:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x71048efc (ffff88b643e76800) 00010000:00010000:0.0:1789583896.367158:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583896.367161:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.367167:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b66df54a00/0x6d3e73d72c6e445a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x71048efc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583896.367283:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+26:14491:x1876514313461120:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 4087us (4903us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789583896.367292:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 44 00000100:00100000:1.0:1789583896.371278:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.371568:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313461248 00000100:00100000:3.0:1789583896.371579:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313461248 00000100:00100000:3.0:1789583896.371709:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:3.0:1789583896.371719:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+26:14491:x1876514313461248:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789583896.371740:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789583896.371762:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4461 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68ea expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.371798:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4468 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.372097:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4468 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.372122:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4468 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.372215:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640030000/0x6d3e73d72c6e4461 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ea expref: 28 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.372234:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031c00/0x6d3e73d72c6e4468 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ea expref: 27 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.372242:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:3.0:1789583896.372244:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789583896.372247:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b640031c00, rc 0) 00000100:00100000:3.0:1789583896.372515:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+27:14491:x1876514313461248:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 796us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583896.372524:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 45 00000100:00100000:3.0:1789583896.378442:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.378991:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313461504 00000100:00100000:2.0:1789583896.379007:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313461504 00000100:00100000:2.0:1789583896.379096:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 46 00000100:00100000:2.0:1789583896.379109:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+27:14491:x1876514313461504:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789583896.379225:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.379246:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.379261:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789583896.382564:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1789583896.382595:0:14430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 453366787791ns, next at 454366782491ns, rc = 0 00000004:00010000:2.0:1789583896.382831:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005439d274 reply state 00000000c98a3523 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.382863:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789583896.383445:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+29:14491:x1876514313461504:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 4333us (5010us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789583896.383456:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 46 00010000:00010000:2.0:1789583896.393007:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.393033:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.393042:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.393049:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583896.393055:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.393063:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.393083:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:2.0:1789583896.393086:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789583896.393093:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.393099:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e446f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583896.394594:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583896.394794:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313461632 00000100:00100000:1.0:1789583896.394839:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313461632 00000100:00100000:1.0:1789583896.394908:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:1.0:1789583896.394919:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+28:14491:x1876514313461632:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583896.394951:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583896.394984:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68f1 expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.395059:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 29 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.395076:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 29 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.395096:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:1.0:1789583896.395099:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789583896.395103:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507c00, rc 0) 00000100:00100000:1.0:1789583896.395169:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+29:14491:x1876514313461632:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 252us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583896.395176:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 47 00000100:00100000:1.0:1789583896.397976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.398073:0:16472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313461760 00000100:00100000:3.0:1789583896.398085:0:16472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313461760 00000100:00100000:3.0:1789583896.398217:0:16472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:3.0:1789583896.398230:0:16472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2358:x1876514313461760:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789583896.398690:0:16472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2358:x1876514313461760:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 462us (727us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789583896.398699:0:16472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 12 00000100:00100000:0.0:1789583896.405331:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.406355:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313462016 00000100:00100000:3.0:1789583896.406376:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313462016 00000100:00100000:3.0:1789583896.406487:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:3.0:1789583896.406499:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+29:14491:x1876514313462016:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789583896.407981:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+30:14491:x1876514313462016:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 1474us (2657us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789583896.407994:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 9 00000100:00100000:1.0:1789583896.413215:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.413445:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313462272 00000100:00100000:0.0:1789583896.413478:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313462272 00000100:00100000:0.0:1789583896.413566:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:0.0:1789583896.413578:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+30:14491:x1876514313462272:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789583896.413739:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+30:14491:x1876514313462272:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 163us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583896.413748:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 48 00000100:00100000:0.0:1789583896.417251:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583896.417373:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313462400 00000100:00100000:1.0:1789583896.417463:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313462400 00000100:00100000:1.0:1789583896.417658:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:1.0:1789583896.417670:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b541c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+30:14491:x1876514313462400:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583896.417705:0:15413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583896.417733:0:15413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506400/0x6d3e73d72c6e447d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68f8 expref: -99 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.417848:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507000/0x6d3e73d72c6e4484 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.417866:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507000/0x6d3e73d72c6e4484 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.417879:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507000/0x6d3e73d72c6e4484 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789583896.417927:0:15413:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789583896.417956:0:15413:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507000/0x6d3e73d72c6e4484 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.418269:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542506400/0x6d3e73d72c6e447d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f8 expref: 32 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.418293:0:15413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507000/0x6d3e73d72c6e4484 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f8 expref: 31 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.418302:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:1.0:1789583896.418322:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789583896.418327:0:15413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507000, rc 0) 00000100:00100000:1.0:1789583896.418480:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b541c5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+31:14491:x1876514313462400:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 811us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583896.418489:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 49 00000100:00100000:1.0:1789583896.423420:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.423689:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313462528 00000100:00100000:3.0:1789583896.423702:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313462528 00000100:00100000:3.0:1789583896.424203:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:1.0:1789583896.424449:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2361:x1876514313462528:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789583896.424766:0:15112:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789583896.424794:0:15112:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcfd1730131ec68ff expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789583896.424894:0:15112:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aaae218, blocks: 0x1 00010000:00010000:1.0:1789583896.424919:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:1.0:1789583896.424924:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583896.424934:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 7 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.424957:0:15112:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 7 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.425037:0:15112:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88b542507a00, rc 0) 00000100:00100000:1.0:1789583896.425300:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2361:x1876514313462528:12345-192.168.203.46@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583896.425315:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:3.0:1789583896.432608:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.433270:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313462784 00000100:00100000:0.0:1789583896.433285:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313462784 00000100:00100000:0.0:1789583896.433457:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583896.433478:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+31:14491:x1876514313462784:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789583896.434509:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+31:14491:x1876514313462784:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 1026us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583896.434531:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 50 00000100:00100000:0.0:1789583896.452567:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.452649:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313462912 00000100:00100000:2.0:1789583896.452662:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313462912 00000100:00100000:2.0:1789583896.452768:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:2.0:1789583896.452789:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+31:14491:x1876514313462912:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789583896.533772:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1789583896.533825:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1789583896.533833:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1789583896.533837:0:5871:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789583896.533883:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:0.0:1789583896.533895:0:5871:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789583896.534252:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789583896.534278:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332315904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789583896.534367:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583896.534465:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332315904 00000100:00100000:0.0:1789583896.534576:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332315904 00000100:00100000:0.0:1789583896.534658:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789583896.534768:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789583896.534801:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876514332315904:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789583896.535101:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789583896.535105:0:15114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789583896.535108:0:15114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789583896.535110:0:15114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789583896 -> 1789583896 00002000:00010000:0.0:1789583896.535113:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789583896.535224:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1876514332315904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 537us (857us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789583896.535232:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789583896.535607:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+14:14491:x1876514313462912:12345-192.168.203.46@tcp:44:lhsmtool_posix.0 Request processed in 82817us (83050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583896.535619:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 51 00000100:00100000:1.0:1789583896.538659:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000004:00080000:2.0:1789583896.538665:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88b668f9c380/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789583896.538678:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3307:1876514332315904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789583896.539256:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313463040 00000100:00100000:0.0:1789583896.539267:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313463040 00000100:00100000:0.0:1789583896.539345:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:0.0:1789583896.539357:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2358:x1876514313463040:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789583896.539592:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2358:x1876514313463040:12345-192.168.203.46@tcp:16:lhsmtool_posix.0 Request processed in 236us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583896.539601:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 15 00000100:00100000:0.0:1789583896.542088:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.545118:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313463296 00000100:00100000:2.0:1789583896.545141:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313463296 00000100:00100000:2.0:1789583896.545236:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:2.0:1789583896.545248:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+14:14491:x1876514313463296:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789583896.545326:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583896.545362:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507000/0x6d3e73d72c6e4484 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f8 expref: 14 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.545533:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:2.0:1789583896.545549:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789583896.545592:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.545609:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.545620:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789583896.547242:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a86d644f reply state 000000001b95af7f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583896.547263:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789583896.547447:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+15:14491:x1876514313463296:12345-192.168.203.46@tcp:36:lhsmtool_posix.0 Request processed in 2194us (5367us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789583896.547457:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 52 00000100:00100000:1.0:1789583896.554976:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00010000:00010000:0.0:1789583896.555596:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.555612:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.555614:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313463424 00010000:00010000:0.0:1789583896.555624:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.555630:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313463424 00010000:00010000:0.0:1789583896.555632:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0800 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:0.0:1789583896.555640:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.555657:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.555679:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:0.0:1789583896.555682:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789583896.555688:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.555694:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0800/0x6d3e73d72c6e4492 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.555759:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:2.0:1789583896.555773:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2358:x1876514313463424:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789583896.556087:0:15114:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789583896.556091:0:15114:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789583895 00002000:00010000:2.0:1789583896.556094:0:15114:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789583895 00002000:00010000:2.0:1789583896.556097:0:15114:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789583896 -> 1789583895 00002000:00010000:2.0:1789583896.556099:0:15114:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789583896.556166:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+8:2358:x1876514313463424:12345-192.168.203.46@tcp:2:lhsmtool_posix.0 Request processed in 395us (1208us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789583896.556174:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 16 00000100:00100000:1.0:1789583896.560032:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.560106:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313463552 00000100:00100000:0.0:1789583896.560119:0:15112:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313463552 00000100:00100000:0.0:1789583896.560189:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789583896.560201:0:15112:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+8:2360:x1876514313463552:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789583896.560258:0:15112:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560280:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583896.560285:0:15112:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583896.560294:0:15112:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560313:0:15112:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560355:0:15112:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560394:0:15112:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560405:0:15112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560413:0:15112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583896.560418:0:15112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560428:0:15112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560447:0:15112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.560456:0:15112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3a1481e/0x6d3e73d72c6e4499 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15112 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583896.561156:0:15112:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+8:2360:x1876514313463552:12345-192.168.203.46@tcp:1:lhsmtool_posix.0 Request processed in 954us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583896.561164:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 17 00000100:00100000:0.0:1789583896.565886:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583896.566047:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313463808 00000100:00100000:1.0:1789583896.566061:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313463808 00000100:00100000:1.0:1789583896.566148:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 53 00000100:00100000:1.0:1789583896.566160:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+14:14491:x1876514313463808:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789583896.566391:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566416:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566431:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566885:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566901:0:15413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 15 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566910:0:15413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566955:0:15413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 15 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.566972:0:15413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 15 pid: 15413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583896.566990:0:15413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332316032:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583896.567219:0:15413:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bf180 going to sleep for 11 seconds 00000100:00100000:1.0:1789583896.583263:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.583475:0:16545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313463936 00000100:00100000:2.0:1789583896.583488:0:16545:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313463936 00010000:00010000:2.0:1789583896.583541:0:16545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 16 pid: 15413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.583596:0:16545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:2.0:1789583896.583607:0:16545:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+16:2359:x1876514313463936:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583896.583628:0:16545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583896.583637:0:16545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 16 pid: 15413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.583654:0:16545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 16 pid: 15413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.583682:0:16545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:2.0:1789583896.583689:0:16545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.583702:0:16545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.583723:0:16545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.583748:0:16545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583896.583925:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507c00/0x6d3e73d72c6e4476 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68f1 expref: 16 pid: 15413 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583896.583947:0:15413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332316032:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583896.583987:0:15413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.583997:0:15413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.584011:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583896.584268:0:15413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789583896.584456:0:15413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789583896.584507:0:15413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789583896.584602:0:15413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15413:1876514332316160:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789583896.586165:0:16545:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+18:2359:x1876514313463936:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 2543us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.586184:0:16545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 13 00000100:00100000:3.0:1789583896.589688:0:15413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583896.589742:0:15413:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a062480 going to sleep for 11 seconds 00000100:00100000:1.0:1789583896.589920:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332316160 00000100:00100000:1.0:1789583896.589936:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332316160 00000100:00100000:1.0:1789583896.590001:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789583896.590014:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15413:x1876514332316160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789583896.590230:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15413:x1876514332316160:12345-0@lo:1000:mdt00_003.0 Request processed in 219us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789583896.590238:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789583896.592980:0:15413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15413:1876514332316160:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789583896.595066:0:15413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789583896.595194:0:15413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15413:1876514332316288:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789583896.595470:0:15413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789583896.596801:0:15413:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b647f60900 going to sleep for 11 seconds 00000100:00100000:1.0:1789583896.600642:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332316288 00000100:00100000:1.0:1789583896.600725:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332316288 00000100:00100000:1.0:1789583896.600994:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789583896.601008:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6752e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15413:x1876514332316288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789583896.601395:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6752e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15413:x1876514332316288:12345-0@lo:1000:mdt00_003.0 Request processed in 390us (5925us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789583896.601404:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789583896.601533:0:15413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752ea680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15413:1876514332316288:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789583896.601598:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601610:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601618:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601625:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583896.601630:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601640:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601691:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:2.0:1789583896.601695:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583896.601701:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601708:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507400/0x6d3e73d72c6e44a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601748:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601756:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601762:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601766:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0c00 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583896.601769:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601786:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601794:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.601796:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789583896.601850:0:15413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 18 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601865:0:15413:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 18 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601887:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 18 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.601959:0:15413:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88b640031600/0x6d3e73d72c6e440d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68d5 expref: 18 pid: 15413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.601975:0:15413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6752eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332316416:192.168.203.46@tcp:105: 00000100:00100000:2.0:1789583896.602084:0:15413:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b647f60840 going to sleep for 11 seconds 00000100:00100000:2.0:1789583896.610708:0:15413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6752eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15413:1876514332316416:192.168.203.46@tcp:105: 00010000:00010000:2.0:1789583896.610757:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610771:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0c00/0x6d3e73d72c6e4406 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610853:0:15413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610871:0:15413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610884:0:15413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610898:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610904:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610928:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610934:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a0400 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583896.610939:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610947:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610961:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.610964:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789583896.610968:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610974:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a0400/0x6d3e73d72c6e44ae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610985:0:15413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610991:0:15413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.610996:0:15413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.611002:0:15413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507600 already unused, calling callback (ffffffffc1fea4f0) 00010000:00010000:2.0:1789583896.611005:0:15413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.611021:0:15413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.611030:0:15413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff88b643e76b00) 00010000:00010000:2.0:1789583896.611032:0:15413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789583896.611035:0:15413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.611039:0:15413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b542507600/0x6d3e73d72c6e44a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.611440:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+18:14491:x1876514313463808:12345-192.168.203.46@tcp:57:lhsmtool_posix.0 Request processed in 45277us (45566us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789583896.611453:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 53 00000020:00080000:2.0:1789583896.611461:0:15413:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789583896.613649:0:14462:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789583896.613660:0:14462:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789583896.613700:0:14462:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789583896.613706:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789583896.615837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789583896.615867:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332316544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583896.615957:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583896.616121:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.616180:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464064 00000100:00100000:2.0:1789583896.616204:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464064 00000100:00100000:2.0:1789583896.616274:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:2.0:1789583896.616285:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b647f32450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+18:14490:x1876514313464064:12345-192.168.203.46@tcp:49:dd.0 00000100:00100000:2.0:1789583896.616451:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b647f32450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+18:14490:x1876514313464064:12345-192.168.203.46@tcp:49:dd.0 Request processed in 167us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.616459:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 10 00000100:00100000:3.0:1789583896.616834:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332316544 00000100:00100000:3.0:1789583896.616841:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332316544 00000100:00100000:3.0:1789583896.616887:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789583896.616898:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876514332316544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789583896.616933:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583896.617062:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876514332316544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583896.617070:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789583896.617170:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3306:1876514332316544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789583896.620567:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.620690:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464320 00000100:00100000:2.0:1789583896.620703:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464320 00000100:00100000:2.0:1789583896.620769:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 11 00000100:00100000:2.0:1789583896.620780:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+18:14491:x1876514313464320:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789583896.621886:0:14434:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789583896.622008:0:14434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789583896.622064:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.622084:0:14434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.622097:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.622106:0:14434:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.622113:0:14434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.622118:0:14434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.622153:0:14434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789583896.623504:0:14418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789583896.623519:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.623531:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1c00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583896.623535:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.623552:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.623570:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff88b64165a100) 00010000:00010000:3.0:1789583896.623589:0:14418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789583896.623595:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.623600:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88b6756a1c00/0x6d3e73d72c6e44b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14434 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.623621:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583896.623622:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789583896.623624:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789583896.623664:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+20:14491:x1876514313464320:12345-192.168.203.46@tcp:35:lhsmtool_posix.0 Request processed in 2877us (3104us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789583896.623676:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 11 00000020:00080000:2.0:1789583896.623683:0:14434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789583896.729029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.729095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:0.0:1789583896.729143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583896.729324:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464448 00000100:00100000:3.0:1789583896.729338:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464448 00000100:00100000:3.0:1789583896.729418:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464576 00000100:00100000:3.0:1789583896.729422:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464576 00000100:00100000:3.0:1789583896.729437:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464704 00000100:00100000:3.0:1789583896.729440:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464704 00000100:00100000:1.0:1789583896.729449:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:1.0:1789583896.729464:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:2359:x1876514313464448:12345-192.168.203.46@tcp:4:dd.0 00010000:00010000:1.0:1789583896.729520:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.729547:0:15118:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 10 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.729558:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583896.729563:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789583896.729569:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.729618:0:15118:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 10 pid: 15112 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789583896.729636:0:15118:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 10 pid: 15112 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789583896.729654:0:15118:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b6485c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15118:1876514332316672:192.168.203.46@tcp:104: 00000100:00100000:1.0:1789583896.729783:0:15118:0:(client.c:2716:ptlrpc_set_wait()) set ffff88b64a7bfd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789583896.736406:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:2.0:1789583896.736675:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464832 00000100:00100000:2.0:1789583896.736924:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464832 00010000:00010000:2.0:1789583896.736984:0:14415:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 11 pid: 15112 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583896.737202:0:15118:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b6485c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15118:1876514332316672:192.168.203.46@tcp:104: 00010000:00010000:3.0:1789583896.737248:0:15118:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.737313:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 14 00000100:00100000:2.0:1789583896.737330:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b674c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+11:2359:x1876514313464832:12345-192.168.203.46@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789583896.737368:0:14415:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789583896.737480:0:14415:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 11 pid: 15112 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.737492:0:14415:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 11 pid: 15112 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.737515:0:14415:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7b78dd/0x6d3e73d72c6e448b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.46@tcp remote: 0xcfd1730131ec68ff expref: 11 pid: 15112 timeout: 553 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.737533:0:14415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583896.737537:0:14415:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583896.737542:0:14415:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.737553:0:14415:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.737590:0:14415:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789583896.737624:0:15118:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583896.737632:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583896.737662:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b674c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:2359:x1876514313464832:12345-192.168.203.46@tcp:103:ldlm_bl.0 Request processed in 335us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789583896.737669:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 14 00000001:00080000:2.0:1789583896.848672:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1789583896.848702:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1789583896.848717:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1789583896.848864:0:15118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789583896.848868:0:15118:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789583895 -> 1789583896 00002000:00010000:0.0:1789583896.848872:0:15118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789583896.848887:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.848900:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.848909:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.848917:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b542507200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583896.848922:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.848931:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.848951:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.848959:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017c777f5/0x6d3e73d72c6e44bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583896.849065:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2359:x1876514313464448:12345-192.168.203.46@tcp:4:dd.0 Request processed in 119601us (120055us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789583896.849092:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 0 00000100:00100000:0.0:1789583896.849123:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789583896.849135:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2358:x1876514313464576:12345-192.168.203.46@tcp:4:dd.0 00002000:00010000:0.0:1789583896.849173:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x6aaae218, atime: 0x6aaae217, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1789583896.849179:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.849191:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1789583896.849195:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583896.849200:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.849221:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789583896.942733:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1789583896.943200:0:15118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:0.0:1789583896.943207:0:15118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:0.0:1789583896.943330:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943348:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943359:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943401:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54200 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583896.943408:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943419:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943445:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943454:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fcf410b/0x6d3e73d72c6e44c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583896.943584:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+6:2358:x1876514313464576:12345-192.168.203.46@tcp:4:dd.0 Request processed in 94447us (214482us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789583896.943596:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 1 00000100:00100000:0.0:1789583896.943636:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:0.0:1789583896.943650:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2359:x1876514313464704:12345-192.168.203.46@tcp:4:dd.0 00002000:00010000:0.0:1789583896.943701:0:15118:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aaae218, atime: 0x6aaae217, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1789583896.943708:0:15118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943721:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=453s v=(0 0) 00010000:00010000:0.0:1789583896.943727:0:15118:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583896.943744:0:15118:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583896.943758:0:15118:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583896.999408:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789583897.020334:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1789583897.020433:0:15118:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1789583897.020439:0:15118:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789583897.020460:0:15118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.020493:0:15118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.020505:0:15118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.020513:0:15118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583897.020519:0:15118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.020529:0:15118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.020559:0:15118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.020589:0:15118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583897.020723:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+5:2359:x1876514313464704:12345-192.168.203.46@tcp:4:dd.0 Request processed in 77071us (291571us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789583897.020735:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 2 00000100:00100000:3.0:1789583897.031586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583897.031632:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583897.031924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:3.0:1789583897.033916:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583897.034035:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313464960 00000100:00100000:1.0:1789583897.034048:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313464960 00000100:00100000:2.0:1789583897.034123:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313465088 00000100:00100000:2.0:1789583897.034128:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313465088 00000100:00100000:2.0:1789583897.034207:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313465216 00000100:00100000:2.0:1789583897.034210:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313465216 00000100:00100000:2.0:1789583897.034229:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:2.0:1789583897.034239:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2358:x1876514313465088:12345-192.168.203.46@tcp:4:dd.0 00002000:00010000:2.0:1789583897.034300:0:15119:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aaae218, atime: 0x6aaae217, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789583897.034311:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.034332:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=454s v=(0 0) 00010000:00010000:2.0:1789583897.034337:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583897.034345:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.034363:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789583897.034831:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789583897.035141:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.46@tcp (source: 12345-192.168.203.46@tcp) 00000100:00100000:1.0:1789583897.035210:0:15120:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789583897.035222:0:15120:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789583897.035676:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313465472 00000100:00100000:1.0:1789583897.035684:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313465472 00000100:00100000:1.0:1789583897.035731:0:15120:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789583897.035738:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514313465344 00000100:00100000:1.0:1789583897.035740:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514313465344 00000100:00100000:2.0:1789583897.036548:0:16658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:2.0:1789583897.036566:0:16658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:2358:x1876514313465216:12345-192.168.203.46@tcp:4:dd.0 00010000:00010000:2.0:1789583897.036613:0:16658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.036636:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583897.036641:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789583897.036647:0:16658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.036677:0:16658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789583897.087770:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1789583897.088329:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:0.0:1789583897.088336:0:15119:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789583896 00002000:00010000:0.0:1789583897.088338:0:15119:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789583897.088355:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.088370:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.088389:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.088526:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1800 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583897.088533:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.088544:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.088589:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.088597:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d62c33/0x6d3e73d72c6e44d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583897.089484:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+12:2358:x1876514313465088:12345-192.168.203.46@tcp:4:dd.0 Request processed in 55233us (57838us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789583897.089500:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 3 00000100:00100000:0.0:1789583897.089549:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583897.089565:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+11:2359:x1876514313464960:12345-192.168.203.46@tcp:4:dd.0 00010000:00010000:0.0:1789583897.089613:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.089631:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583897.089637:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583897.089645:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.089661:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583897.138953:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1789583897.142443:0:16658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1789583897.142471:0:16658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142487:0:16658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142497:0:16658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142505:0:16658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b6756a1a00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:3.0:1789583897.142511:0:16658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142520:0:16658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142545:0:16658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142553:0:16658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008591d1af/0x6d3e73d72c6e44d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789583897.142680:0:16658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+11:2358:x1876514313465216:12345-192.168.203.46@tcp:4:dd.0 Request processed in 106114us (110750us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789583897.142719:0:16658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 4 00000100:00100000:3.0:1789583897.142764:0:16658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 6 00000100:00100000:3.0:1789583897.142779:0:16658:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+10:2359:x1876514313465472:12345-192.168.203.46@tcp:4:dd.0 00010000:00010000:3.0:1789583897.142860:0:16658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142875:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583897.142881:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789583897.142889:0:16658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789583897.142902:0:16658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789583897.180601:0:15119:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00010000:00010000:0.0:1789583897.180631:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.180675:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.180755:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.180764:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df55600 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583897.180770:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.180781:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.180842:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.180851:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f3fbdb/0x6d3e73d72c6e44df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583897.180967:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+12:2359:x1876514313464960:12345-192.168.203.46@tcp:4:dd.0 Request processed in 91401us (149389us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789583897.180992:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 5 00000100:00100000:0.0:1789583897.181033:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.46@tcp, seq: 7 00000100:00100000:0.0:1789583897.181047:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b67af5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+11:2359:x1876514313465344:12345-192.168.203.46@tcp:4:dd.0 00010000:00010000:0.0:1789583897.181090:0:15119:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.181111:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583897.181116:0:15119:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789583897.181124:0:15119:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.181138:0:15119:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789583897.183214:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:1.0:1789583897.229779:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1789583897.236733:0:16658:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1789583897.236761:0:16658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.236783:0:16658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.236793:0:16658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.236800:0:16658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b640030000 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:2.0:1789583897.236822:0:16658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.236832:0:16658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.236852:0:16658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789583897.236860:0:16658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a21e4eb/0x6d3e73d72c6e44e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789583897.236985:0:16658:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+9:2359:x1876514313465472:12345-192.168.203.46@tcp:4:dd.0 Request processed in 94207us (203077us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789583897.236995:0:16658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 6 00010000:00010000:0.0:1789583897.275422:0:15119:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.275441:0:15119:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.275450:0:15119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.275457:0:15119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff88b66df54e00 already unused, calling callback (ffffffffc158d8b0) 00010000:00010000:0.0:1789583897.275462:0:15119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.275471:0:15119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.275490:0:15119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789583897.275516:0:15119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c0d1f6d/0x6d3e73d72c6e44ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15119 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789583897.275641:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b67af5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ed077288-dbc1-4a86-bd3d-7e15f0b68daf+7:2359:x1876514313465344:12345-192.168.203.46@tcp:4:dd.0 Request processed in 94594us (240498us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789583897.275651:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.46@tcp, seq: 7 00000001:00080000:1.0:1789583897.275670:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000040:00080000:2.0:1789583897.641665:0:14462:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789583897.641675:0:14462:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789583897.641709:0:14462:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789583897.641715:0:14462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789583898.022953:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789583898.670499:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789583898.670529:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332316800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789583898.670637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789583898.670724:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332316800 00000100:00100000:3.0:1789583898.670734:0:15116:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332316800 00000100:00100000:3.0:1789583898.670823:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789583898.670835:0:15116:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332316800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789583898.670882:0:15116:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789583898.670931:0:15116:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b6485c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876514332316800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583898.670938:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789583898.671091:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b67af5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3305:1876514332316800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789583898.671579:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332317056:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.671630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583898.671658:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789583898.671664:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332316928:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.671697:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583898.671728:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332317440:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.671757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583898.671791:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332316928 00000100:00100000:0.0:1789583898.671798:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332316928 00000100:00100000:0.0:1789583898.671867:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789583898.671876:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b676c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3308:x1876514332316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.671920:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b676c3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bec31d4c-70f2-4e81-b20d-79c0fd90522d+19:3308:x1876514332316928:12345-0@lo:400:kworker.0 Request processed in 45us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583898.671927:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789583898.672132:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332317440 00000100:00100000:0.0:1789583898.672136:0:14431:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332317440 00000100:00100000:0.0:1789583898.672171:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789583898.672179:0:14431:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332317440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672233:0:14431:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876514332317440:12345-0@lo:400:kworker.0 Request processed in 55us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583898.672241:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789583898.672268:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332317312:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583898.672317:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789583898.672323:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff88b668f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332317184:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672346:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789583898.672387:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332317312 00000100:00100000:0.0:1789583898.672391:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332317312 00000100:00100000:0.0:1789583898.672415:0:15413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332317184 00000100:00100000:0.0:1789583898.672418:0:15413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332317184 00000100:00100000:0.0:1789583898.672433:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583898.672438:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332317312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672473:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876514332317312:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583898.672479:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789583898.672490:0:15413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583898.672495:0:15413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332317184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672522:0:15413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876514332317184:12345-0@lo:400:kworker.0 Request processed in 26us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789583898.672526:0:15413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789583898.672557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876514332317184:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672582:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3306:1876514332317312:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672615:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:bec31d4c-70f2-4e81-b20d-79c0fd90522d:3308:1876514332316928:0@lo:400:kworker.0 00000100:00100000:0.0:1789583898.672635:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3308:1876514332317440:0@lo:400:kworker.0 00000100:00080000:0.0:1789583898.672671:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789583898.672677:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789583898.673108:0:16472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876514332317056 00000100:00100000:3.0:1789583898.673116:0:16472:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876514332317056 00000100:00100000:3.0:1789583898.673162:0:16472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789583898.673171:0:16472:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff88b668f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332317056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789583898.673224:0:16472:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff88b668f9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876514332317056:12345-0@lo:400:kworker.0 Request processed in 56us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789583898.673231:0:16472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789583898.673271:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789583898.673276:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88b668f9c380, transno 8589934595 00000004:00080000:3.0:1789583898.673290:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789583898.673309:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff88b668f9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3308:1876514332317056:0@lo:400:kworker.0 00000100:00080000:1.0:1789583898.677140:0:14426:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789583898.738769:0:16697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789583899.046926:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789583900.072702:0:14418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28811 lines, 28811 kept, 0 dropped, 0 bad.